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ABSTRACT 


This thesis documents the findings of the Naval Postgraduate School (NPS) 
research team’s efforts on the initial phase of the Iraqi Enrollment via Voice 
Authentication Project (lEVAP). The lEVAP is an Office of the Secretary of Defense 
(OSD) sponsored research project commissioned to study the feasibility of speaker 
verification technology in support of the Global War on Terrorism security requirements. 
The intent of this project is to contribute toward the future employment of speech 
technologies in a variety of coalition military operations by developing a pilot proof-of- 
concept system that integrates speaker verification and automated speech recognition 
technology into a mobile platform to enhance warfighting capabilities. 

In this first phase of the lEVAP, NPS developed with the assistance of Nuance 
Communications, Inc. and the Defense Eanguage Institute, a bilingual (English and 
Jordanian-Arabic) speech application that demonstrates the viability of speaker 
verification technology for use in operations in Iraq. Additionally, NPS conducted a test 
to assess the accuracy claim of Nuance's packaged speaker verification application. 
Nuance Caller Authentication 1.0 (for North American English). The NPS test consisted 
of 68 speaker enrollments and 411 speaker verification attempts. Upon completion of the 
test, NPS conducted a single data-point analysis yielding a system accuracy of 95.87%. 
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I. INTRODUCTION 


A. OVERVIEW 

This master thesis doeuments the findings of the initial phase of the Iraqi 
Enrollment via Voiee Authentieation Projeet (lEVAP). The lEVAP is an Offiee of the 
Secretary of Defense (OSD) sponsored research project that studies the feasibility of 
speaker verification and speech recognition technology in support of the Global War on 
Terrorism (GWOT) security requirements. 

Currently, there is no consistent method of personal identification for the Iraqi 
populace. This lack of consistent identification contributes to an overall lack of security 
and impacts stabilization efforts by the sovereign Iraqi Government and Coalition forces. 
An urgent need exists for a means to accurately identify individuals who require access 
through controlled entry points to secure areas. The lEVAP responds to this need by 
drawing on a key biometric technology-speaker verification-and coupling it with 
identification data to enhance force protection and to control entry into secure points 
within the country [1]. 

The intent of the lEVAP is to contribute toward the future employment of speech 
technologies in a variety of coalition military operations by developing a pilot proof-of- 
concept (POC) system that integrates commercial-off-the-shelf (COTS) speaker 
verification and automated speech recognition (ASR) technologies into a mobile platform 
to enhance warfighting capability. 

It is envisioned that when used in conjunction with other biometric systems and 
security procedures, speaker verification applications can become a primary tool in 
positively identifying individuals and in controlling access to secure areas. Once the 
POC has been established, additional applications using speaker verification and ASR 
technologies may be developed to enable the delivery of additional services. Moreover, 
lEVAP is an initiative that transcends the potential implementation in Iraq. A successful 
POC could lead to applications in other stabilization and reconstruction efforts elsewhere, 
such as in Afghanistan. 
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B. BACKGROUND 

The Naval Postgraduate School (NPS) has been tasked by the OSD with 
developing and demonstrating a pilot POC system in support of the lEVAP. The lEVAP 
is organized into several project phases that are intended to take the POC system from 
concept development to operational testing in Iraq. This thesis documents the findings of 
the first two sub-phases (Phase 1A and Phase IB) within Phase 1 of this project, which 
are as follows: 

• Phase 1. Pilot menu-driven laptop system and demonstration that voice 
authentication technology can work with sufficient accuracy. 

• Phase lA. Develop and demonstrate a bilingual voice-activated 
menu-driven phone system in English and Arabic. 

• Phase IB, Test and demonstrate speaker verification technology 
in English. 

• Phase 1C. Test and demonstrate speaker verification technology 
in Iraqi-Arabic. 

• Phase 2. Detailed development of enrollment applications 

• Phase 3. Preparation of systems/applications for deployment 

• Phase 4. Deployment 

• Phase 5. Operational testing in Iraq 

• Phase 6. Broader deployment decision 

C. RESEARCH QUESTIONS 

• Is it possible to create and deploy a mobile speaker verification platform 
using existing COTS technologies to assist in operations in support of the 
GWOT security requirements? 

• What COTS applications are currently available to perform speaker 
verification capabilities? 
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• What are the performance measures of a speaker verification system? 

• What are the strengths and limitations of existing COTS speaker 
verification technology? 

D. SCOPE OF THESIS 

This thesis focuses on the technologies addressed in support of Phase lA and IB 
of the lEVAP, which includes the development and demonstration of a bilingual (English 
and Jordanian-Arabic) voice-activated menu-driven telephone system and an analysis of 
results of the NPS Speaker Verification Test. The value of this research includes: 

• Demonstrating the viability of speaker verification and ASR technology 
for subsequent research, development, and possible real-world 
implementation. 

• Providing a “quick response” research and development capability to 
address external customer requirements. 

• Selecting the most appropriate hardware, software, and peripherals for a 
mobile demonstration kit (laptop, voice input devices, etc) for 
implementing speaker verification and ASR technologies. 

E. RESEARCH METHODOLOGY 

This research uses the quantitative approach for data collection and analysis. This 
research consists of the development of a bilingual (English and Jordanian-Arabic) 
application to assist in detainee visitation at the Baghdad Central Correction Facility 
(BCCF), formerly known as the Abu Ghraib Detention Facility. This research also 
consists of an analysis of the COTS speaker verification software. Nuance Caller 
Authentication (NCA) 1.0 (for North American English). Additionally, a literature 
review consisting of various studies, reports, and other documentation related to the field 
of speaker verification technology is also presented. 
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F. 


THESIS ORGANIZATION 


Chapter II introduces speaker verification technology. Chapter III provides an 
overview of Nuance Communication, Inc. and its core technologies, operating platform 
and packaged applications. Chapter IV describes the development of the bilingual 
(English and Jordanian-Arabic) voice-activated menu-driven phone system application, 
including the identification of the equipment (hardware, software, and peripherals) used 
to develop and demonstrate the pilot POC system and the design methodology and 
application features of the bilingual voice-activated menu-driven system. Chapter V 
describes a test to assess the performance of the NCA speaker verification application 
using the Nuance's North American English language verification master package 
(language module), to include the identification of equipment (hardware, software and 
peripherals) used to conduct this test and an analysis of the results of the NPS Speaker 
Verification Test. Finally, Chapter VI concludes with recommendations for future work. 
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II. SPEAKER VERIFICATION TECHNOLOGY 


A. OVERVIEW 


Speaker verification also known as voice authentication or voice verification is 
not a new technology. i Dating back to the 1960s, considerable research in this field has 
occurred in academia and the commercial sectors [2] [3]. And with the exponential 
growth in technological advances in computational processing power and in 
communication, speaker verification has become a viable form of biometric technology. 


In the taxonomy of Speech and Language Processing (see Figure 1), Speaker 
Verification falls under the classification of Speaker Recognition with the goal to extract, 
characterize and recognize the information in the speech signal conveying speaker 
identity [3]. Within speaker recognition, there are two fundamental tasks, which are 
often mistaken for one another, speaker identification and speaker verification. 


Speech & Language Processing Taxonomy 


Speech 

DeieCTion 


l^^i^rocessin^^J 



Speech 

Translation 


Figure 1, Speech and Language Process Taxonomy [After Ref. 4] 

^ Though the terms verification and authentication are generally used interchangeably, there is a subtle difference 
in the actual interpretation of these terms. Verification refers to the process of comparing (matching) a presented voice 
sample against another voice sample in the system with a previously claimed identity. Authentication refers to a 
process similar to verification with the additional constraint of an independent means, such as, a personal identification 
number (PIN) or a fmgeiprint biometric to validate the identity of the claimant other than voice verification alone. 
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The first task, speaker identification, is the task of determining who is talking 
from a set of known voices or speakers. In speaker identification, the unknown person 
makes no identity claim, so the system must perform a 1;N classification. The second 
task, speaker verification, is the task of determining whether a person is who he or she 
claims to be. In speaker verification applications, the system validates a person's identify 
by comparing the captured voice biometric data with his or her stored voice biometric 
data, which is to say that a system performs a 1:1 classification [3]. 

Most commercial applications today fall in the category of speaker verification 
vice speaker identification. The main reason is because it is far easier and quicker (and 
vastly more accurate) to determine a 1:1 classification than 1 :N classification. However, 
this does not mean that advances have not been achieved in speaker identification 
technology. Today, there is a great deal of research in the advancement of speaker 
recognition technologies, such as, improving the performance of speaker recognition 
systems using high-level information [5], developing recognition techniques for multi¬ 
speaker environments [6], developing and evaluating corpora for speech processing 
systems [7], and developing and testing of multi-modal biometric systems, e.g., fusion of 
fingerprint and speaker verification systems [8]. For additional information regarding the 
topic of speaker recognition refer to references [2], [3], [9], [10] and [11]. 

B. SPEAKER VERIFICATION PROCESS 

The basic structure for a speaker verification system is shown in Figure 2. A 

speaker verification system has two distinct phases, the first is the enrollment phrase and 

the second is the verification phase. In the enrollment phrase, the speech signal is first 

processed to extract features conveying speaker information, and then a voice model is 

created based on the collected data from the speech signal, which is then stored in a 

database for later reference during the verification phase. In the verification phase, the 

speech signal is again processed to extract features conveying speaker information; 

however, this time instead of creating a voice model, the speaker verification system 

implements a likelihood ratio test to distinguish between two hypotheses to determine if 

the speech sample comes from the claimed speaker or from an imposter. Features 

extracted from the speech signal are compared to a model representing the claimed 
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speaker (obtained from a previous enrollment) and to some background or composite 
model representing potential imposter speakers. The ratio of the speaker and the imposter 
match scores is the likelihood ratio statistic, which is then compared to a set threshold to 
decide whether to accept or reject the speaker [12]. 


Speaker Verification Process 



Figure 2, Speaker Verification Process [After Ref, 13] 

C. PERFORMANCE MEASURES 

Performance of a speaker verification system is based on the measure between 
two types of errors found in biometrics system. The two types of errors that can occur in 
biometrics systems are False Match Rate (FMR) and False Non-Match Rate (FNMR), 
more commonly referred as False Accept Rate (FAR) and False Reject Rate (FRR) [10]. 

• False Accept is the false acceptance of an invalid user, such as in the case 
of an impostor breaking into a system (also known as a Type-I error). 

• False Reject is the false rejection of a valid user, such as in the case of 
rejecting a true speaker (also known as a Type-II error). 
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The tradeoff between FAR and FRR exists in every biometrie system. For 
instance, if a system's threshold is set to allow for greater user convenience, the 
probability of false rejections (FRR) decreases, and the likelihood that an imposter can 
break into the system (FAR) increases. Likewise, the opposite would hold true, if a 
system's threshold is set to allow for greater user security, the probability of false 
rejections increases (FRR rises) while the likelihood that an imposter breaks into the 
system decreases (FAR diminishes). System performance at all the operating points 
(thresholds) can be depicted in the form of a receiver operating characteristic (ROC) 
curve. A ROC Curve is a plot of FAR against FRR for various threshold values for a 
given application. An example of an ROC Curve is shown in Figure 3, in which the 
desired area for a given application is at the lower left of the plot, where both types of 
errors are minimized. 


Receiver Operation Characteristics (ROC) Curve 



Figure 3, Receiver Operating Characteristics (ROC) Curve 


^ Fukunaga, K., Introduction to Statistical Pattern Recognition, Academic Press, 1990. ROC curve analysis was 
developed in the early 1950’s during World War II to detect weak radio signals in noise. Since then it has become the 
de facto standard statistical tool for quantifying and measuring system performance. 
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In Figure 3, the point where the FRR and FAR are equal is ealled the equal error 
rate (EER). Often the EER is used as the single summary number to gauge the 
performanee of a speaker verification application [14]. The green line shown in Figure 3 
represents the various pairs of (FAR, FRR) values corresponding to a possible set of 
thresholds to which a given application can be set. For instance, in applications that 
required greater security, one would set the threshold of an application to the left of the 
ERR along the green curve, reflecting a lower probability of false accept but at the same 
time accepting a higher probability of false reject. 

More recently, a variant of an ROC curve, called the detection error tradeoff 
(DET) curve has been employed, especially in the academic and national research 
institutions. The DET curve plots the same tradeoff shown in a ROC curve using a 
normal deviate scale [12]. This has the effect of moving the curves away from the lower 
left comer when performance is high and producing linear curves. The advantage of a 
DET curve over a ROC curve is that it allows easier comparisons of multiple data sets. 
Eigure 4 shows the comparison of a data set plotted on two different curves, the DET 
Curve and the ROC Curve. For additional information on the ROC analysis and 
hypothesis testing principles note references [9], [10] and [15]. 



Figure 4, ROC Curve and DET Curve [From Ref. 14] 
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D. 


SYSTEM ACCURACY 


Within the context of speaker verification technology, system accuracy is 
dependent on numerous factors, such as the level of user cooperation and the type of 
system constraints levied on a given application. In speaker verification applications, 
speech used for system enrollment and verification can span from text-dependent to text- 
independent, resulting in different levels of system performance. In a text-dependent 
application, a speaker states the same text during enrollment and verification and the 
speaker-verification system has prior knowledge of this text. Whereas in a text- 
independent application, the system has no prior knowledge of the text to be spoken, 
which makes it more complex for the system to process [12]. Figure 5 depicts a DET 
curve with a different level of constraints for four speaker verification experiments. The 
data represented in Figure 5 are based on verification experiments conducted by 
Reynolds, D.A. [12]. With each level of constraints, ranging from category 4 (text- 
independent using read sentences) to category 1 (text-dependent using combination lock 
phrases) the level of system performance increases; however, a caveat to increasing the 
level of constraints on a system is that the system becomes less user friendly. 



Legend: 

1. Text-dependent using combinations lock 
plirases, e.g., 35-41-89. 

(Accuracy Rate: 99.9% - 99%) 

2. Text-dependent using 10 digit strings. 

(Accuracy Rate: 99% - 95%) 

3. Text-independent using conversational 
speech. 

(Accuracy Rate: 93% - 85%) 

4. Text-independent using read sentences. 

(Accuracy Rate: 80% - 65%) 


0.1 0.2 O.S 1 2 0 10 20 40 

_ Probability Of False Accept (in %) _ 


Detection Error Tradeoff Plot 


Figure 5, DET Curve Accuracy Constraints [After Ref. 12] 
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E. 


COMPARISON OF VARIOUS BIOMETRICS 


How does speaker verifieation compare to other forms of biometrics? A number 
of biometric characteristics exist and are used in various applications. Each biometric has 
its strengths and weaknesses and the choice depends on the application. No single 
biometric is expected to meet the requirements of all the applications effectively. The 
match between a specific biometric and an application is determined depending upon the 
perceived user profiles, the need to interface with other systems or databases, 
environmental conditions, cost, and the properties of the biometric characteristic [15]. 
Table 1 presents a comparison of the leading forms of biometric system. 




Comparison of Biometrics 



Characteristics 

Fingerprint 

Hand 

Retina 

Iris 

Face 

Signature 

Voice 

Ease of Use 

High 

High 

Low 

Medium 

Medium 

High 

High 

Error Incidence 

Dryness, dirt, 
age 

Hand injury, 
age 

Glasses 

Poor lighting 

Lighting, age, 
glasses, hair 

Changing 

Signatures 

Noise, colds, 
channel 

variables 

Accuracy 

High 

High 

Very high 

Very high 

High 

High 

High 

User Acceptance 

Medium 

Medium 

Medium 

Medium 

Medium 

Very high 

High 

Required Security 
Level 

High 

Medium 

High 

Very high 

Medium 

Medium 

Medium 

Long Term Stability 

High 

Medium 

High 

High 

Medium 

Medium 

Medium 


Table 1. Comparison of Biometrics [After Ref, 16] 

In addition to the characteristics compared in Table 1, there are other 
characteristics that favor the use of voice biometrics, which are remote-ability, flexibility, 
maintenance and cost. In terms of perceived applications for operations in Iraq, these 
characteristics are unmatched when contrasted to other forms of biometrics. 

First, voice biometrics uses existing telecommunication infrastructures (landline, 
cellular or Voice over Internet Protocol [VoIP]), as such, a new infrastructure is not 
required to be built around the deployment/employment of this technology, which 
reduces costs and deploys technology rapidly. Second, voice biometrics allows 
dissemination and collection of information other than key biometric data, such as, the 
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collection of names, addresses, and telephone numbers of high-target individuals. Third, 
voiee biometries ean be employed in multilingual applieations without the aid of a trained 
linguist or a translator, whieh results in manpower savings. And fourth, voice biometrics 
rely on a signal that is natural and unobtrusive to produee and is easily obtainable with no 
special user equipment or training, which results in the rapid deployment of teehnology 
without adding additional training requirements for troops serving in Iraq and Iraqi 
eitizens. 

However, as with any given biometric system, there are limitations in addition to 
its strengths. First, speeeh is a behavioral signal that may not be consistently reprodueed 
by a speaker and can be affected by a speaker's health, emotions, and age. Second, voice 
biometries is dependent on the communieation infrastructure; therefore, if the 
transmission quality of the eommunication infrastrueture is poor, it may hamper the 
performanee of the voiee biometrie system. Third, remote-ability, which is one of voiee 
biometries greatest strengths is also one of its limitations. Without plaeing eonstraints on 
the remote-ability of a speech application, one cannot control the type of eharmel (e.g., 
landline or different types of cell phones) or the environment (e.g., noisy or quiet 
background) that a user selects to dial-up the speech application. And fourth, as with 
other forms of biometries system, system spoofing (identify thief) is a concern that 
requires eareful consideration of employment taeties, techniques, and procedures (TTP). 
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III. NUANCE COMMUNICATIONS, INC. 


A. OVERVIEW 

Headquartered in Menlo Park, California, Nuance Communications, Inc., is a 
publicly held company that develops speech recognition, speaker verification and text-to- 
speech applications. Nuance is an industry leader in the deployment of voice interfaces 
that provide automated speech applications to enterprise telecommunications and web- 
based applications. Nuance currently has over 1,000 customers who have purchased their 
software for applications ranging from banking, stock trading, product ordering, personal 
assistants, voice-activated dialing, call routing, and voice portal services. Some of their 
clients includes: Cingular Wireless, Sprint PCS, T-Mobile, Japan Telecom, Banco 
Bradesco, British Airways, Charles Schwab, Merrill Lynch, General Motor's OnStar and 
United Parcel Services [17]. 

More recently on May 9^*^, 2005, ScanSoft (another industry leader in voice 
interfaces) and Nuance announced that they have signed a definitive agreement whereby 
ScanSoft will acquire all of the outstanding common stock of Nuance, merging the two 
organizations into a single company-retaining the corporate identity of Nuance 
Communications, Inc. [18]. 

Provided in this chapter is a general overview of Nuance’s core technologies, 
platform and packaged applications. The below information was gathered from 
datasheets that are readily accessible from Nuance’s website at http://www.nuance.com/ 
prodserv/prodnuance.html and can also be found in Nuance's "Nuance Voice Platform 
(NVP): Getting Started Guide" [19]. 

B. CORE TECHNOLOGIES 

Nuance’s core technologies are comprised of three primary engines: speech 
recognition, text-to-speech, and speaker verification that enable recognition and 
understanding of simple responses and complex conversational requests, the conversion 
of written information into speech, and the authentication of an individual's identity. 
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First is Nuance's current release of speech recognition software, Nuance 8.5, 
which is based on a distributed client/server architecture that provides scalable operation. 
A major advantage of Nuance 8.5 is that it supports simultaneous load balancing and 
fault tolerance across speech recognition, speaker verification and text-to-speech 
operations to ensure efficient use of system resources. 

Nuance 8.5 supports many languages, including American English, 
Australian/New Zealand English, Canadian French, Cantonese, European French, 
German, Italian, Japanese, Jordanian Arabic, Mandarin, Portuguese, Spanish, Swedish 
and UK English. In addition to multilingual support. Nuance 8.5 also offers numerous 
advanced features and capabilities. Listed below are some of the advanced features and 
capabilities available using Nuance 8.5 (for a complete listing of these features refer to 
Nuance’s website): 

• Say Anything^'^ is a feature that includes Nuance’s statistical language 
models (SLM) and robust natural language interpretation (robust NL) 
technologies. It enables automation of complex and open-ended dialogs 
that are difficult or impossible to implement using traditional grammars. 

• Listen & Learn^^ is a task adaptation feature. Task adaptation is a self¬ 
tuning feature of the Nuance System that automatically improves 
recognition performance of deployed applications. 

• AccuBurst^'^ is a dynamic accuracy feature that allows the recognizer to 
trade off accuracy against speed according to the load of the machine on 
which it is miming. With dynamic accuracy turned on, the system uses 
resources when they are available. The recognition rate is then improved 
during non-busy hours without any noticeable slowdown for the user. 

Second is Nuance’s text-to-speech (TTS) software. Nuance Vocalizer 4,0, which 
delivers text-based, frequently changing information over the telephone with a natural 
sounding voice. It also reduces the need to pre-record information required in 
applications, reducing the overall costs of voice-driven application development. Nuance 
Vocalizer 4.0 is currently available in U.S., U.K. and Australian English, in both male 
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and female voiees, and Canadian Freneh and Latin Ameriean Spanish in female. Nuance 
also supports a total of 18 TTS languages through a combination of Nuance Vocalizer 4.0 
and partner languages. Arabic TTS is currently not available in Vocalizer 4.0. 

Third is Nuance’s voice authentication software, Nuance Verifier 3.5. Verifier 
3.5 enables users to be identified and authenticated simultaneously based on their voice 
biometrics. The technology is not currently BioAPI-compliant. The technology supports 
several languages including: Australian/New Zealand English, Brazilian Portuguese, 
Canadian French, Cantonese Chinese, Dutch, European French, European Spanish, 
German, Italian, Japanese, Korean, Eatin American Spanish, Mandarin Chinese, South 
African English, Swedish, US/Canadian English and UK English. Arabic is currently not 
supported. 

Nuance Verifier 3.5 has several features that place it prominently above many of 
its competitors: 

• Verifier offers three modes of operation for enrollment and verification: 
Text-dependent, Text-prompted, and Text-independent modes. In text- 
dependent mode, the same utterance is used for enrollment (training) and 
verification. In text-prompted mode, verification is performed against a 
phrase that was not necessarily used for training, but the Verifier knows 
what the verification phrase should be. In text-independent mode, 
verification is performed against a phrase that was not necessarily used for 
training and the Verifier does not know what the verification phrase 
should be. 

• Verifier uses variable-length-verification (VEV), a mechanism that 
provides accurate results with the smallest number of verification 
utterances. 

• Verifier uses online adaptation, which is a feature that allows a system to 
adapt a stored voice model automatically during a verification session if it 
determines that the user is the true speaker. 
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• Verifier ean aeeurately verify individuals aeross eross ehannels. For 
instanee, a person ean enroll using a landline telephone and be verified on 
a eellular phone. 

• Verifier can effectively filter out background noises. This is one reason 
Nuance notes that Sprint PCS and GM OnStar use Nuance technology for 
their voice interface. 

• Verifier's voice model, referred to as a “voiceprinf ’ by Nuance, remains at 
a constant size of 20 kilobytes. Nuance's voice models are encrypted and 
stored in standard scalability databases, such as Oracle and ODBC- 
compliant databases. These databases can be networked so that one 
centralized repository can serve multiple call-centers. 

C. VOICE PLATFORM 

Nuance core technologies reside on a platform called Nuance Voice Platform 
(NVP) 3.0. Platforms are the foundation on which voice applications are developed and 
deployed. They execute the commands and logic specified by the voice application, 
provide the speech processing capabilities, enable application creation, interface to back¬ 
end systems and call center infrastructure, and provide system management and 
administration capabilities. 

NVP 3.0 is based upon Voice Extensible Markup Language (VoiceXML) 2.0 
markup language standard. VoiceXML 2.0 is the current international standard 
developed by World Wide Web Consortium (W3C) VoiceXML Forum. VoiceXML 2.0 
is used to define a standard dialog design language that developers could use to build 
conversational applications. VoiceXML is designed to create audio dialogs that feature 
synthesized speech, digitized audio, recognition of spoken and DTMF key input, 
recordings of spoken input, telephony, and mixed initiative conversations [20]. 

NVP 3.0 consists of four major components, which are described below, and is 
shown in Figure 6. 
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Figure 6, Architecture View of Nuance Voice Platform 3,0 [From Ref. 19] 

• The Nuance Conversation Server includes a VoiceXML Interpreter 
integrated with Nuance’s speech recognition, text-to-speech and voice 
authentication technologies. Using standard Internet protocols, the 
Nuance Conversation Server fetches VoiceXML applications generated by 
the Nuance Application Environment or other application frameworks. 
The Nuance Conversation Server also provides the interfaces to the 
telephony network via support for commercial-off-the-shelf (COTS) 
telephony network interface cards or through support for Voice over 
Internet Protocol (VoIP) through Session Initiated Protocol (SIP). 

• The Management Station provides an intuitive graphical user interface 

(GUI) for configuring, deploying, administering, and managing voice 
applications. It also provides centralized management of the services on 
the Conversation Server hosts. The three main functions of the 

management station are System Management and Control, System 
Performance Analysis and Data Management. 
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• The Nuance Application Environment (NAE) is an integrated graphical 
application development and runtime environment that facilitates the 
design, development, deployment, and maintenance of speech 
applications. This framework can run on widely used application servers 
to create dynamically generated VoiceXML applications. The voice 
application can readily integrate to a broad range of backend databases, 
applications, and legacy systems using web services standards and a 
variety of pre-packaged interfaces offered by application server vendors. 
Application developers can also analyze and tune voice application 
performance and usability. Additionally, a key feature of NAE is that it is 
an intuitive development environment that enables reusability of 
application modules. 

• The Nuance Computer Telephony Integration (CTI) Gateway provides 
packaged integrations to leading CTI servers. NVP 3.0 can be integrated 
into CTI environments from leading vendors such as Aspect, Cisco, and 
Genesys, allowing enterprises to deploy a best-of-breed, integrated contact 
center solution that can provide callers with a consistent, high-quality user 
experience. 

D. PACKAGED SPEECH APPLICATIONS 

Nuance also offers several packaged off-the-shelf and easily configurable 
products that can enable enterprises to shorten application development and deployment 
time dramatically, accelerate return on investment, and cost-effectively access advanced 
application design and development experience. Provided below are two packaged 
applications that Nuance currently offer. 

• Nuance Caller Authentication (NCA) 1.0 is a packaged application that 
automatically authenticates callers prior to accessing account or personal 
information using automated systems or talking with a customer service 
representative. Powered by Nuance Verifier, NCA 1.0 authenticates 
callers based on the unique characteristics of their voice. Using voice 
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authentication results in higher levels of security than more traditional 
means of identifying callers, such as touch-tone systems that require 
personal identification numbers (PINs) or agent questions. 

Nuance Call Steering (NCS) 1,0, powered by Say Anything™ 
technology, allows callers to interact with an automated speech- 
recognition based solution that enables them to speak naturally and then to 
be quickly routed to the correct destination. NCS 1.0 serves as a gateway 
to an organization’s contact center, enabling companies to establish a 
single point of contact and instantly route callers to the customer care 
solution best equipped to meet their needs. 
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IV. BILINGUAL VOICE-ACTIVATED MENU-DRIVEN SYSTEM 


A. PHASE lA OVERVIEW 

The primary objective of this phase of the lEVAP is to develop a bilingual 
(English and Jordanian-Arabic) speech application that demonstrates the viability of 
speech technology to support operations in Iraq. 

The purpose of the bilingual Baghdad Central Correctional Eacility (BCCF) 
Visitor Center Application is to demonstrate the feasibility of using COTS technology in 
order to create a pilot proof-of-concept (POC) system in order to expedite a visitor’s 
entry to a controlled facility/secure space and to assist in managing detention visitation at 
BCCF. It is envision that this application would assist in: 

• Expediting and improving the visitation process at the BCCF, thereby 
improving the overall force protection, security, and the management of 
the detention facility and the detainees. 

• Reducing the necessity for travel by visitors to schedule meetings with 
detainees at BCCF and to better manage access to detainees on the day of 
visitation. 

• Providing a method of generating a voice biometric database that will be 
of potential value in combating the insurgency in Iraq. 

• Improving public relations with the Iraqi people by providing improved 
and safer access to detainees. 
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There are two applieations envisioned for the demonstration of this pilot system: 

• BCCF Visitor Verification and Access Application. An application is 
envisioned whereby an Enrollee would arrive at a predetermined visitation 
time at BCCF, speak into a device, have his or her voice authenticated, 
and be granted access to the visitor’s area. The BCCF visitor verification 
application is intended to reduce the level of “hands on” validation 
required by security personnel and to increase the speed with which an 
Fnrollee can have a scheduled meeting with a Detainee. The BCCF 
application is expected to complement or improve on existing visitation 
procedures. The improved ease of access might encourage individual 
enrollment [1]. 

• BCCF Visitation Scheduling Application. Visitation scheduling is a 
complementary application. A previously enrolled individual would have 
the ability to gain access to a BCCF visitation scheduling application. 
This application would be remotely accessible by landline or cell phone. 
When the application is accessed, the BCCF would take the applicant 
through a series of steps to authenticate the requestor’s voice biometric, 
and only upon successful authentication would the requestor be granted 
access to the detainee visitation scheduling application. Voice prompts or 
some other method would guide the Fnrollee through a scheduling system 
with the result being the generation of a designated time to arrive at BCCF 
for a visit. There is potential for a corollary use of voice authentication, 
where the requestor, by stating the name of the Detainee, could be added 
to the Detainee’s visitor schedule, allowing detainment facility staff to 
pre-screen visitors [1]. 

The application whose requirements are specified in this document allows callers 
to obtain information on visitation information, obtain general directions to the BCCF, 
and schedule appointments (simulated) to visit detainees at BCCF in both English and 
Jordanian-Arabic, see Figure 7. 
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Figure 7, High-Level Diagram for BCCF Visitor Center Application 

Figure 7 (as depicted above) is a high-level call-flow diagram for the BCCF 
Visitor Center Application. In this application, a Caller is prompted by the system to 
choose a language to proceed in, either in English or in Jordanian-Arabic. Once a Caller 
selects a language, the system then proceeds to the language specific main menu. At this 
point, the system asks the Caller to select an application to obtain information on 
visitation information, to obtain general directions to the detention facility (BCCF), or to 
schedule an appointment (simulated) to visit a detainee at BCCF.3 If the Caller chooses 
to receive visitation information or obtain directions to the detention facility, speaker 
verification is not required. The prerecorded prompts will automatically play when 
required. If the Caller chooses to schedule a new appointment or to check up on an 
existing appointment, speaker verification is required before the Caller is granted access 
to the automated scheduling system. This is to ensure that access is only given to 
authorize visitors of the BCCF detainees. 


3 This prototype application is intended to demonstrate the call-flow of the BCCF application in English and in 
Jordan-Arabic, and it is not connected to a backend database, as such, the appointment scheduling is a simulated 
process. 
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B. EQUIPMENT LIST 

The pilot POC system used the following equipment (hardware, software, and 
peripherals) to develop and demonstrate the application. 

I. Hardware 

Based on the software requirements of Nuance, NFS purchased the following 
hardware to develop and demonstrate this application, see Figure 8. 

• Dell Latitude 15.4” D810 Intel Pentium M770 Processor (2.13 GHz), 2 
GB DDR2-533 SDRAM, 80GB Hard Drive, Intel Pro/Wireless 2915 
(802.11 a/b/g, 54 Mbps) and integrated Bluetooth 

• Dell Latitude 12” D410 Intel Pentium M755 Processor (2.00 GHz), 2 GB 
DDR2-533 SDRAM, 80GB Hard Drive, Intel ProAVireless 2915 (802.11 
a/b/g, 54 Mbps) and integrated Bluetooth 

• Sony F-V420 Unidirectional Natural Sound Vocal Microphone. 

Two computers (host) are required to demonstrate the bilingual application [21].^ 
The laptop computers listed above were chosen for their processing power, memory 
capability, and mobility. The input device (microphone) was selected based on its ease of 
use in developing and testing the speech application. 


^ Currently, Nuance cannot run multilingual applications on the same host. Thus two hosts are required, one 
operating under English locale in Windows 2000 and the other operating under Jordanian-Arabic locale in Windows 
2000. Locale is an environment variable that is set within the Microsoft Windows Operating System. Locale is a set of 
information that corresponds to a given language and country. The code locale setting affects the language of terms 
such as keywords and defines locale-specific settings such as the decimal and list separators, date formats, and 
character sorting order. Nuance uses the locale environment variable to identify the primary locale for the platform. 
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Figure 8, Diagram of BCCF Visitor Center Application System 

2, Software 


Listed below are the software applieations used to develop and demonstrate this 
application: 

• Microsoft’s Windows 2000 Professional 

• Sun’s Java 2 SDK 1.3.115 

• Nuance Voice Platform 3.0. SP4 

• Nuance Application Environment 3.0 SP4 

• Nuance Vocalizer 4.0 

• SIPFoundry’s SipXphone. 

Currently, Nuance is only tested against Microsoft Windows 2000 operating 

system. However, Nuance is capable of operating under Microsoft’s Windows 2003 and 

Windows XP Professional operating systems. Sun’s Java 2 SDK is a development 

environment for building applications, applets, and components using the Java 

programming language. This software is downloadable from Sun’s website at 

http://java.sun.eom/j2se/l.3/ download.html. The SIPfoundry SipXphone was selected 

for its compatibility with Nuance’s software. SIPfoundry’s SipXphone is shareware 
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program that can be downloaded at SIPfoundry’s website at www.sipfoundry.org. 
SipXphone was formerly known as Pingtel's instant xpressa softphone, and it is a fully 
functional SIP softphone that runs on Microsoft Windows and Linux operating systems. 

The bilingual BCCF Visitor Center Applieation was designed and developed 
using Nuanee Application Environment (NAE). As mentioned in Chapter III, NAE is an 
environment within NVP where applieations ean be developed, tested, and exeeuted. 
Information provided on the following pages was referenced from Nuanee's V-Builder 
3.0 Feature Paek 1 User's Guide [22]. NAE consists of two components: V-Builder and 
V-Server. 

V-Builder is the design eomponent of NAE. V-Builder is a produetivity tool that 
facilitates many of the funetions required to develop open, standards-based speech 
applications, such as: 

• VoiceXME code generation 

• Grammar development and testing 

• Prompt recording and playback 

• Voice application testing. 

V-Builder also facilitates many tasks common to all application development, 
including project management, version control, and application deployment. 
Additionally, V-builder allows developers to instant generate preformatted Dialog 
Specifications document, which affords developers the ability to document their 
applieations design. Eigure 9, is a sereenshot of the bilingual BCCE Visitor Center 
Applieation within the V-builder environment. 
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Figure 9, BCCF Visitor Center Application within NAE 

V-Builder provides an integrated environment for developing and testing voice- 
enabled applications based on the VoiceXML 2.0 markup language standard. V-builder's 
primary goal is to bring the advantages of web-based development and content delivery 
to interactive voice response applications. It simplifies speech application development 
by allowing a developer to create speech applications graphically. A developer can pick 
dialog states from a palette of choices and drop them into the graphical call flow. The 
developer then defines the state details in related property sheets. Based on the design 
created, V-Builder then generates the VoiceXML code for the application. The 
advantage of using V-builder is that no knowledge of VoiceXML or programming is 
required to create a working sample or prototype speech application. 

The other component of NAE is V-Server. V-Server is the runtime component of 
the NAE. V-Server is a web application that runs inside a J2EE web server. It currently 
supports the JBoss, WebEogic, and WebSphere web servers. V-Server manages and 
exposes functionality for V-Builder speech applications at runtime, enabling them to: 
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• Access data from Enterprise Information Systems (EIS) such as Oracle, 
PeopleSoft, and Siebel that hold customer data. 

• Integrate with third-party Computer Telephony Integration (CTI) servers 
like the Genesys IVR server and CiseoICM, which provide features like 
sereen pops, eall routing based on eallers’ needs and agents’ skills, and 
universal queue management (that is, using a single queue to manage 
telephony and web-based queries.) 

V-Server also provides operation, administration and maintenanee integration 
with NVP so that when speeeh applieation is generated by V-Builder, a user ean monitor 
and control it through the Nuanee Management Station. 

C. APPLICATION DEVELOPMENT PROCESS 

The BCCF Visitor Center Applieation was developed using Nuanee's projeet 
methodology as deseribed in the Nuanee NVP Applieation Developer's Guide [23]. The 
Nuanee methodology eonsists of five phases whieh are 

• Phase 1: Requirement Analysis eonsists of identifying the business, user, 
and applieation requirements 

• Phase 2: Design foeuses on the user interfaee by defining dialogs, 
prompts, and grammars, as outlined in the requirement phase 

• Phase 3: Implementation eonsists of building the speeeh application, 
recording audio prompts, and completing the reeognition paekage 

• Phase 4: Testing foeuses on testing the speeeh applieation for dialog 
traversal and system load, speeoh-reeognition performanee, and usability 
testing 

• Phase 5: Tuning and Monitoring is the proeess of improving a speeeh 
application based on deployment data.^ 


^ For the development of this prototype POC system, only the first four phases were implemented. Phase 5- 
Tuning and Monitoring was not conducted because this application is a proof-of-concept application that was not 
deployed as an operational application, as such, no deployment data was collected. 
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Appendix A of this thesis provides the Dialog Specifieation for the bilingual 
BCCF Visitor Center Application. The Dialog Specification document encapsulates all 
of the required information to create this program. Provided below is the pertinent 
information regarding the development of this pilot POC system. 

1. Requirements Collection 

The requirements used to develop this application were gathered from the 
following sources: 

• E-mail correspondence from Mr. Doman McArthur, OSD dtd 22 Feb 05 
and 11 Dec 04 

• E-mail correspondence from Maj Robert Berry, USA dtd 25 Jan 05 

• Iraqi Enrollment via Voice Authentication Project Concept of Operations 
Version 2.0 

• Naval Postgraduate School Proof-of-Concept: Iraqi Enrollment via Voice 
Authentication Project Test Plan Version 1.0 

• Baghdad Central Correctional Facility Standard Operating Procedure 
(SOP) 10: SOP Family Visitation dtd 3 Jun 04 

• BCCF SOP 14: SOP Visitation Center dtd 30 Aug 04. 

2. User Definition 

Based on email correspondence with the Operations Officer of the BCCF [24], the 
following user profile was generated: Visitors of detainees are between the ages of 18 and 
50. They consist mostly of family members of the detainees, often wives, children, 
mother, and fathers. It is assumed that the visitors are generally repeat visitors. It is also 
assumed that visitors are unfamiliar with the use of speaker verification and ASR 
technology. 
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3, User Expectation 

Based on the data collected in support of defining this pilot POC application, the 
following are assumed user expectations: 

• It is assumed that Callers of this pilot POC system will be unfamiliar with 
the use of speaker verification and automated speech recognition (ASR) 
technology. As such, a help menu and a directed dialog are required to 
assist Callers to complete calls. 

• This is an official Department of Defense (DoD) system; as such a persona 
of professionalism is required. However special attention must be given to 
the fact that the majority of Callers to this system will be the family 
members of the Detainees; therefore, careful consideration of their culture 
and customs is also a necessity. Additionally, as with the existing US 
Correction Facility visitation information system. Callers of this system 
are expected to request directions to the detention facility and will request 
visitation information, such as hour of operations or general visitation 
procedures. 

• For the purposes of the pilot POC system, it is assumed that Callers will 
follow the prompted menu structure. This POC system will employ a 
directed dialog vice a mixed-initiative dialog. In a directed dialog, the 
system gives the Caller a list of options at the beginning of the interaction; 
it then prompts the Caller to make a selection. In a mixed-initiative 
dialog, a Caller chooses what he or she wants to do and describes it in 
natural language. 

4. User Success Criteria 

It is assumed that the user success criteria for this application are task completion, 
ease of call, and speed of call. 
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D. APPLICATION CALL-FLOW 


Provided on the following pages is a description of the BCCF Visitor Center Call- 
Flow to include the actual system prompts. Figure 10 is a diagram of the described 
process. For additional information regarding the BCCF Visitor Center Call-Flow refer 
to Appendix A (Dialog Specification for BCCF Visitor Center Application) of this thesis. 


Baghdad Central Correctional Facility Visitor Center Application 



Figure 10, Detailed Call-Flow Diagram for the BCCF Application 
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1. start (WelcomeBCCF) 

When initially calling the system, the Caller is greeted with a bilingual welcome 
message: "Hi, Welcome to Baghdad Central Correctional Facility’s Visitor Center (same 
prompt repeated in Arabic)." 

2. Language Selection (SelLanguage) 

After the initial greeting, a Caller is prompted to select a language: "To continue 
in English, say 'English.' To continue in Arabic, say 'Arabic' (Arabic welcome prompt 
spoken in Jordanian-Arabic)." Once a Caller has chosen a language, the system proceeds 
to the language specific main menu. 

3, Language Specific Main Menu (MainMenu) 

Upon reaching the language specific main menu, a Caller is given the option to 
hear visitation information, obtain general direction to BCCF, or schedule an 
appointment to visit a detainee: “Thanks. Please select from the following options. To 
get general visitor information, including visiting hours, say 'information.' To get 
directions to our facility, say 'directions.' To set up a meeting using our automated 
scheduling system, say ‘scheduling.’ ” 

4, Visitation Information (Visitinformation) 

If a Caller selects this option, the system plays back a prerecorded prompt stating 
the hours of operation for the BCCF Visitor Center: “Baghdad Central Correctional 
Facility is open for visitors from 8 AM to 4 PM, Monday through Saturday. Would you 
like to hear that information again or return to the main menu? If you’re done for now, 
please feel free to hang up.”^ 


^ The system demonstration in Phase lA is limited only to the playback of hours of operations for BCCF. Future 
prerecorded prompts can contain additional sub-dialogs detailing additional visitation information, such as BCCF’s 
Visitation Operation Standard Operations Procedure (SOP). 
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5, Directions to BCCF (Directions) 

If a Caller selects this option, the system plays hack a prerecorded prompt stating 
general directions to the detention facility: “Baghdad Central Correctional Facility is 
located 20 miles west of Baghdad, in the town of Abu Ghraib. From Baghdad, go west 
on highway six for 18 miles then take exit nine at Abu Ghraib. Our facility is located two 
miles southwest of exit nine. Would you like to hear the directions again or return to the 
main menu? If you’re done for now, please feel free to hang up.” 

6, Visitation Scheduling (Scheduling) 

If a Caller selects this option, the system plays back an initial prompt asking the 
Caller if he or she has enrolled in the system. If the Caller replies "yes," then the system 
will proceed to the speaker verification dialog. If the Caller replies "no," the system will 
proceed to the speaker enrollment dialog. 

System: “In order to use our automated scheduling system, you must be an 
enrolled user. Are you an enrolled user? If you are, say ‘yes. ’ If you ’re not, say 
‘no ’ and I’ll help you to enroll in our system. ” 

Caller: “Yes. ” 

System: “To get started, go ahead and say or key-in your lO-digit account 
number. ” 

Caller: “No. ” 

System: “To get started on the voice enrollment process, I need your 10-digit 
account number. If you don’t have an account number, or if you’ve lost it, please 
go to your nearest police station to register for a new account. If you have the 
account number, go ahead and say or key it in now. ” 

Note: In this POC application, NPS is using a Caller’s registration number as the 
unique identifier to match a Caller’s voice sample with his or her stored voice model. As 
mentioned in paragraph 1.1 of the lEVAP CONOPS 2.0, “There is no consistent method 
of personal identification for the Iraqi populace" [1]. In order to make this particular 
technology work, a Caller must be assigned a unique identifier to match a Caller’s voice 
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sample with the Caller’s stored voiee model. It is not praetieal to use names as the 
unique identifier because numerous people can have the same name. 

Also, the designated remote system enrollment facility, whether it is a police 
station or other designated facility, must have the capability to assign visitor registration 
or account numbers and to have access to the BCCF detainee database in order to retrieve 
and to associate a visitor’s registration/account number with a Detainee’s Internment 
Serial Number (ISN). 

7, Confirm Visitor Registration (Account) Number (NbrCount2) 

If the caller provides a 10-digit account number, the system asks the Caller to 
confirm his or her answer. If the Caller confirms his or her answer, the system then 
checks to see if the account number is valid or not. Once, the system has validated the 
account number, the system then asks the Caller to repeat from one to nine in order to 
authenticate the Caller’s voice biometric. If the system authenticates the Caller, the 
system proceeds to the next dialog. If the system does not authenticate the Caller, the 
system repeats the authentication process. If on the third attempt the system cannot 
authenticate the Caller, then the system plays back a prompt informing the Caller to re¬ 
register or will connect the Caller to a live agent (if available).^ 

System: “Thanks, I heard 8005551212 is that right?” 

Caller: “Yes. ” 

System: “Now to verify your voice, please count out-loud from one up to nine. ” 

Caller: “1-2-3-4-5-6-7-8-9” 

System: “You ’re been verified. ” 


^ The system demonstration in Phase 1A does not demonstrate speaker verification technology. This feature will 
be simulated with ASR prompts. 
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8, Make or Confirm Appointment (DetailScheduling) 

If the system authenticates the Caller, the system asks the Caller if he or she wants 
to schedule a new appointment or whether he or she wants to check to see if a requested 
appointment is scheduled. If the Caller chooses to schedule a new appointment, then the 
system asks the Caller to provide the ISN of the Detainee the Caller wishes to visit. If the 
Caller chooses to check to see if an appointment is scheduled, then the system informs 
the Caller if an appointment is scheduled or not.^ 

System: “Next, please select from the following options. If you’d like to make a 

new appointment, say 'new appointment.' If you ’d like to check the status of a 

pending appointment, say ‘check appointment.' ” 

Caller: “New Appointment. ” 

System: “In order to make a new appointment, you must have the detainee’s 

Internment Serial Number, or ISN. Do you have the ISN? ” 

Caller: “Yes. ” 

System: “Please say or key in all 9-digits of the detainee’s ISN. ” 

Caller: “111222333. ” 

9. Confirm Detainee ISN (DetaineelSN) 

The system asks the Caller to confirm the ISN of the Detainee the Caller wishes 
to visit. If the system verifies that the Caller is a registered visitor of the Detainee, then 
the system allows the Caller to proceed to scheduling. If the system does not verify that 
this is a registered visitor of the Detainee, then the system repeats a prompt to inform the 
Caller that he or she is not a registered visitor of the Detainee. The system then prompts 
the Caller to proceed to his or her initial system enrollment facility to add the Caller to 
the Detainee’s list of registered visitors. 

System: “Thanks, I heard 111222333 is that right? ” 

^ The system demonstration in Phase 1A does not provide the option to check if an existing appointment request is 
scheduled. A prerecorded prompt replies that there are no pending appointments. “Based on our records, you have no 
scheduled appointments at this time. If you’ve called earlier to set up an appointment, note that it takes 24 hours for the 
appointment to get scheduled. Please check back at a later time.” 
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Caller: “Yes. ” 


System: “Next, please wait while I check to see if you ’re a registered visitor of the 
detainee with ISN111222333. ” 

System: “Thanks. I’ve confirmed that you ’re a registered visitor of Abu Musab 
Al-Zarqawi. ” 

10. New Appointment (GetVisitDate) 

Once the system has verified the Caller’s identity and that the Caller is a 
registered visitor of the Detainee, the system then prompts the Caller to provide the day 
and time of the requested visit in a preserihed format sueh as May 21, 2005, 12 PM.9 

System: “Please tell me the date for when you’d like to visit Abu Musab Al- 
Zarqawi. Please say a complete date, including the month, day and year. For 
example, you could say May 18, 2005. ” 

Caller: “June 23, 2005. ’’ 

System: “Next, tell me the time you’d like to visit. You can choose any time 
between the hours of 8 AM to 4 PM. ” 

Caller: “2:30 PM. ’’ 

System: “Thanks, I heard that you ’d like to visit Abu Musab Al-Zarqawi on June 
23, 2005 at 2:30 PM is that right? ” 


^ There is a difference in the concatenation strategy for the reply of dates in Arabic as compared to English. For 
instance, in English, a Caller is expected to say a date in the following format "May 21, 2005"; however, in Arabic, 
Callers use digits to describe dates, such as "21-5-2005." To adjust for difference in this concatenation strategy, an 
application developer can write a grammar file (code) that allows for the input of dates in the following format dd-mm- 
yyyy. Additionally, Nuance’s also offers “Say Anything” grammars, which is a feature that includes Nuance’s 
statistical language models (SLM) and robust natural language interpretation (robust NL) technologies. This enables 
automation of complex and open-ended dialogs that are difficult or impossible to implement using traditional 
grammars. For this pilot POC system, neither strategy was implemented due to time and budgetary constraint. For the 
Jordanian-Arabic scheduling application, a recording prompt was substituted for the date recognition process. 
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11. Confirm New Appointment (ConflrmDateTime) 

Once the ealler has provided the required information, the system asks the Caller 
to eonfirm the appointment. If the Caller replies "yes," the appointment is stored in a 
database for proeessing. If the Caller replies "no," the system asks the Caller what 
variables, date or time, the Caller would like to ehange. Onee the ehange is eompleted, 
the information is stored in a database for processing. 

Caller: “Yes. ” 

System: Thanks; I’ve submitted the details of your request for this visit. Please 

call us back in 24 hours to see if your requested visit has been scheduled. Thank 

you for Baghdad Central Correctional Facility Visitor Center, Good Bye. ” 

The demonstration of Phase lA eoneludes with a playbaek confirmation of the 
requested appointment. 

E. PHASE lA SUMMARY 

In this ehapter, NFS has sueeessfully developed and demonstrated a bilingual 
voiee-aetivated menu-driven system based upon the BCCF seenario, as defined by the 
sponsor of this projeet, OSD. The purpose of the BCCF Visitor Center Applieation was 
to demonstrate the feasibility of using low-cost COTS technologies in order to ereate a 
pilot proof-of-coneept (POC) system in order to expedite a visitor’s entry to a eontrolled 
faeility/seeure spaee and to assist in managing of detention visitation at the BCCF. 
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V. NPS SPEAKER VERIFICATION TEST 


A. PHASE IB OVERVIEW 

The purpose of the NPS Speaker Verification Test was to test the accuracy claims 
of Nuance’s speaker verification technology based on the performance measures of false 
reject rate (FRR) and false accept rate (FAR).'° This test was conducted using Nuance's 
packaged speaker verification application, Nuance Caller Authentication (NCA) 1.0 
using their North American English Language Verification Master Package. Powered by 
Nuance's Verifier, NCA uses voice biometric technology to capture the physical and 
behavioral characteristics of the human voice in a voice model [25]. 

B. EQUIPMENT LIST 

For this test, the following equipment (hardware, software, and peripherals) were 
used to test and to demonstrate this application. 

1, Hardware 

Based on the software requirements of Nuance, NPS purchased the following 
hardware in order to conduct this test, see Figure 11. 

• Dell Latitude 15.4” D810 Intel Pentium M770 Processor (2.13 GHz), 2 
GB DDR2-533 SDRAM, 80GB Hard Drive, Intel Pro/Wireless 2915 
(802.11 a/b/g, 54 Mbps) and integrated Bluetooth. 

• Intel NetStructure PBX-IP Media Gateway, 8 Ports (Analog Model). 

The laptop computer was chosen for its processing power, memory capability, 
and mobility. Nuance recommends (at a minimum) using a 1 GHz processor with 2 GB 
RAM on Microsoft Windows 2000 based system. In distributed architectures, the 
minimum requirement is 3 GB RAM. The Intel NetStructure PBX-IP Media Gateway 


The initial objective of Phase IB of the lEVAP was to compare the accuracy claims of the three best-of-breed COTS 
speaker verification vendors, which were Nuance Communications, Inc., ScanSoft, Inc., and Voicevault Ltd, currently 
known as Biometric Security Ltd. The orginial goal was to compare the performance of best-of-breed speaker 
verification vendors and select an individual vendor to develop the pilot POC speaker-verification system. However, 
due to self-elimination, two out of the three voice vendors, namely, ScanSoft, Inc., and Voicevault Ltd., were not 
evaluated in this research. Hence, Nuance Communications, Inc. was evaluated in this project. 

39 



was selected for its compatibility with Nuance’s software. The Intel PBX-IP Media 
Gateway is a telephony gateway appliance that connects to as many as eight analog 
phone lines through its digital telephony interface and connects to a LAN via a 10 BaseT 
or 100 BaseT Ethernet connector. For this test, an analog gateway model was chosen 
over a digital gateway for its flexibility in connecting to various telephone line 
connections. 



Figure 11, Diagram of NCA Speaker Verification System 
2, Software 

Listed below are the software applications used to conduct this test: 

• Microsoft’s Windows 2000 Professional 

• Sun’s Java 2 SDK 1.3.115 

• Nuance Voice Platform 3.0. SP4 

• Nuance Caller Authentication (NCA) 1.0 

• Nuance Vocalizer 4.0 

• Oracle’s 9i Database 

• SIPFoundry’s SipXphone. 
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Currently, Nuance is only tested against Windows 2000 operating system. 
However, it is noted that Nuance is capable of operating with Microsoft’s Windows 2003 
and Windows XP Professional operating system. Sun’s Java 2 SDK is a development 
environment for building applications, applets, and components using the Java 
programming language. This software is downloadable from Sun’s website at 
http://java.sun.com/j2se/ 1.3/download.html. The SIPfoundry SipXphone was selected 
for its compatibility with Nuance’s software. SIPfoundry’s SipXphone is a shareware 
program that can be downloaded at SIPfoundry’s website at www.sipfoundry.org. 
SipXphone was formerly known as Pingtel's instant xpressa softphone, and it is a fully 
functional SIP softphone that runs on Microsoft Windows and Linux. 

C. TEST ENVIRONMENT 

The NPS Speaker Verification Test was conducted remotely. All calls made to 
the system were routed from the Caller’s choice of communication medium (landline, 
cell phone or VoIP) to the NCA system via three analog phone lines connected to the 
Intel PBX-IP Media Gateway. The NCA system was setup in the Wireless Warfare 
Laboratory located in Glasgow Hall (Room 103) at NPS in Monterey, California. During 
the setup of the speaker verification test, special features of the NCA application were 
intentional disabled in order to determine the raw estimates of the accuracy of the system 
without any fine-tuning. The two features that were disabled included: Variable Length 
Verification (VLV) and Online Adaptation [25]. 

• Variable Length Verification is a mechanism used by NCA for providing 
the most accurate results based on the fewest utterances. In the NPS 
Speaker Verification Test, this feature was intentionally disabled in order 
to collect more voice data for the offline impostor test. 

• Online Adaptation is a feature that allows a system to adapt a stored voice 
model automatically during a verification session if it determines that the 
user is the true speaker. For the majority of calls, the system collected two 
utterances during the verification process. 
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D. 


TEST SCHEDULE 


Table 2 presents the planned and aetual eompletion test sehedule for Phase IB. 


Task 

Planned 

Completion Date 

Actual 

Completion Date 

System Installation 

1 Apr 05 

On Schedule 

System Design (Phase IB Test Plan) 

1 Apr 05 

On Schedule 

System Test IB.l 

(English Speaker Verification Test 1) 

21-22 Apr 05 

20-24 Apr 05* 

System Test IB.2: 

(English Speaker Verification Test 2) 

5-6 May 05 

2-8 May 05* 

Nuance Offline Analysis 

13-20 May 05 

On Schedule 

NPS Analyze Data/Draft Report 

21-30 May 05 

On Schedule 

Conduct Demonstration 

& Preliminary Report Submission 

31 May 05 

6 Jun 05 

Note (*): Test dates were expanded to allow for additional caller participation. 


Table 2. Phase IB Test Schedule 


E. TEST PROTOCOL 

The test protocol for the speaker verification test consisted of four steps. In step 
one, invitation letters were sent via email to participating organizations (OSD, 
Massachusetts Institute of Technology (MIT) and NPS) requesting volunteers to 
participate in this research. The invitation letter provided the prospective volunteers with 
a general overview of the NPS Speaker Verification Test, to include a sample call dialog 
of the speaker enrollment and speaker verification process, applicable participation 

consent forms, and post-test survey. And as part of the NPS/DOD regulations for the use 
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of human subjects, the NPS research team obtained permission from the NPS Human 
Resource Board prior to conducting any testing. For additional information on the 
Invitation Letter for the NPS Speaker Verification Test refer to Appendix B of this thesis. 
In step two, on specified test dates, participants were asked to dial a given telephone 
number to enroll and to verify their voice biometric. Participants were given the 
opportunity to call into the test system during a 24-hour period on four successive days to 
make their call(s). In step three, participants were asked to enroll once and then verify 
four times during the first test (20-24 Apr 05) and to verify again six times during the 
second test (2-8 May 05). During the enrollment process, participants were asked to 
register with the system with a unique 10-digit identification number and an arbitrary 4- 
digit personal identification number. Participants were then asked to say the numbers 1 
to 9 three times. These three instances of voice samples were used for generating a 
unique model of the participant’s voice pattern. During the verification process, the 
participants registered with the unique ID and then were asked to speak the sequences of 
numbers 1 to 9, a total of two times. Finally, in step four, the results of the NPS Speaker 
Verification Test was published and disseminated. 

F. TEST ANALYSIS 

The analysis of the NPS Speaker Verification Test was conducted in three phases. 
The first phase consisted of an analysis of the call log (basic statistics) of the verification 
test, resulting in a single data-point analysis. The second phase consisted of an analysis 
of the off-line impostor test conducted by Nuance on the NPS data set, resulting in a 
ROC Curve analysis. Lastly, the third analysis phase consisted of a comparison of the 
single data-point analysis with the results of the ROC Curve analysis. 

1. Basic Statistics 

Provided in Figures 12 through 14 are the summary of the basic statistics of the 
NPS Speaker Verification Test. 
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Figure 12 presents the aggregate speaker enrollment data, which consisted of 68 
test subjects enrolled during the two test phases, with a 51-speaker enrollment during the 
first test phase and a 17-speaker enrollment during the second test phase. 
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Figure 12, Speaker Enrollment Report 

Figure 13 (on page 45) presents the aggregate speaker verification data, consisting 
of 411 verification attempts equally divided between the two test phases, with 204 
verification attempts during the first test phase and 207 verification attempts during the 
second test phase. Figure 14 (on page 45) presents the number of verification attempts 
per voice model (Caller). Note that in Figure 14, two callers had a very large number of 
verification attempts (combined total of 77 calls), compared to others (334 calls) for a 
total of 411 speaker verification attempts in the dataset. In a subsequent analysis, this 
outlier effect is accounted for by computing the FRR and FAR with and without 
including the two-outlier cases. 
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Figure 13, Speaker Verification Report 
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Call-Log Analysis: 


46 verification attempts out of a total of 411 verification 
(11.1%) were rejected by the system as valid speakers. 

Phase 1: 24 out of 204 (11.8%) were 
Phase II: 22 out of 207 (10.6%) were 

rejected 

rejected 

12 Calls (Failure to Enroll) 
12 Calls (Incomplete Data) 
10 Calls (Correct Rejects) 

12 Calls (True Failures) 




Voice Model 


Figure 14, Number of Verification Attempts per Voice Model (Caller) Report 


45 








































2, Nuance ROC Curve Analysis 

Upon completion of the NPS Speaker Verification Test, the raw test data were 
extraeted from the system and sent to Nuance for their offline analysis. The offline-test 
performed by Nuanee consisted of a test whereby each speaker's verification attempt was 
tested against every enrolled voice model in the database. This offline impostor test 
resulted in a series of ROC Curves that plotted the FAR versus the FRR at various system 
defined thresholds. The EER of the system, the points on the ROC Curve at whieh the 
EAR equals the FRR, was also measured and reported. The process for the ROC Curve 
generation consisted of five steps. In step one, raw data from the NCA applieation was 
extraeted via a program called “TuningExport” [25]. In step two, a pass at generating the 
basie statistics of the NCA test applieation was generated. In step three, the failed 
verification attempts were validated to determine which calls were correct rejects. In step 
four, a second pass at the basic statistics of the NCA test application was generated 
(ineorporating the correet rejects from the previous step). And in step five, the ROC 
Curve was generated using a Nuanee utility called "batchree" [25]. 

Eigures 15 to 18 are the ROC Curves plots generated from Nuance's offline 
analysis. Figure 15 is the ROC Curve diagram of the NPS Speaker Verification Test data 
set. An inspection of Figure 15 shows an EER of 3.0%. Eigure 16 is a ROC Curve plot 
with and without the inclusion of identical speakers. Figure 17 is a ROC Curve plot with 
and without the inclusion of the two most frequent speakers, termed outliers. Finally, 
Figure 18 is a ROC Curve plot by test phases. Note that in Figure 18, Phase Two's EER 
of 3.4% was slightly higher versus the Phase One's EER of 2.5%. This may be explained 
due to the session effect, i' 


^ ^ A session effect refers to the nature of the variation in the voice quality. 
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ROC Curve 



Figure 15, ROC Curve for NFS Speaker Verification Test 


ROC Curve 



Figure 16, ROC Curves (with and without Identical Speakers) 
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Figure 17. ROC Curves (with and without Outliers) 



Figure 18, ROC Curves (by Test Phase) 
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Figure 19 compares the NFS Speaker Verification Test data set with Nuance's 
comparison data set. When compared to the NFS data set, the average values of FRR and 
FAR from Nuance's similar data sets fell within the expected range, specifically around 
3% EER. 


ROC Curve 



Figure 19, Data-Set Comparison with Expected Performance 

On average, the Nuance comparison data set exhibits an EER of 3.4%. The 
reason for the slight difference may be explained by the fact that the Fhase Two test was 
conducted within only two weeks of the Fhase One test, whereas in reality the Nuance 
technology can verify voice signals recorded over a longer period (months or years). 
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3, Comparison Analysis (Single Data-Point versus ROC Curve) 

The detailed analysis by NPS resulted in a sub-classification of many rejected 
attempts as false rejections, incomplete data sets, correct rejections, imposter attempts, as 
well as enrollment failures. In the context of the single data-point analysis, NPS defines 
the total number of valid verification attempts as: 


NT = NTAR + NFRR + NFAR + NTFR. 
where, 

NT The total number of valid verification attempts 

NTAR The total number of true accepts 
NFRR The total number of false rejects 

NFAR The total number of false accepts 

NTFR The total number of true failures. 


False Reject Rate (FRR) = NFRR / NT 

False Accept Rate (FAR) = NFAR / NT 

Accuracy of the System = ( NT - ( NFRR + NFAR ) ) / NT 

= ( NTAR + NTFR) / NT 


Note: Nuance presents only FRR and FAR. However, it is NPS' contention that 
the accuracy of the system = 100 - (FRR+FAR). See Table 3 on the next page for a 
comparison of the NPS analysis versus the Nuance analysis and Appendices C, D, and E 
for additional details. 
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DISCUSSION 

ITEM 

NUANCE ANALYSIS 

NPS ANALYSIS 

NPS ANALYSIS 
(EXCLUDES 2 OUTLIERS) 

1. Enrollment 

Total Speakers Enrollment: 71 

Total Speakers Enrollment: 68 

Total Speakers Enrollment: 66 


Phase 1 (15-24 Apr 05): 54 

Phase 2 (2-8 May 05): 17 

Phase 1 (15-24 Apr 05): 51 

Phase 2 (2-8 May 05): 17 

Phase 1 (15-24 Apr 05): 49 

Phase 2 (2-8 May 05): 17 


Note: Nuahce considered 
enrollment data trom 15 Apr 05 to 

8 May 05. 

Note: NPS considered enrollmem 
data from 20 Apr 05 to 8 May 05. 

Note: Two high callers (outliers) 
were excluded from this analysis. 

2. Total Nbr of 
Rejected Calls 

Total Nbr of Rejected Calls: 46 

(Details not provided) 

Total Nbr of Rejected Calls: 46 

Failure to Enroll: 12 

Incomplete Data: 12 

Correct Rejects: 10 

True Failures: 12 

Total Nbr of Rejected Calls: 39 

Failure to Enroll: 12 

Incomplete Data: 10 

Correct Rejects: 9 

True Failures: 8 

S.Valid 

Veritication 

Attempts 

Valid Verification Attempts: 411 

Phase 1:204 

Phase 2: 207 

Valid Verification Attempts: 411 

Successes: 389 

True Failures: 12 

Correct Rejects: 10 

Valid Verification Attempts: 336 

Successes: 319 

True Failures: 8 

Correct Rejects: 9 


Note: Identified by Phase only 

Note: Identified by Call Type 

Note: Identified by Call Type 

4. True Failures 

True Failures: 7 

True Failures: 12 

True Failures: 8 

5. False 
Acceptance 

(Details not provided) 

False Acceptance: 5 

False Acceptance: 5 

6. Accuracy 
Analysis 

Nuance ROC Analysis 

FRR = 3.0% 

FAR = 3.0% 

Accuracy = 94.0% 

NPS Single Data-point Analysis 

FRR = 2.91% 

FAR = 1.22% 

Accuracy = 95.87% 

NPS Single Data-poInt Analysis 

FRR = 2.38% 

FAR = 1.48% 

Accuracy = 96.14% 



This data point is slightly better 
than what Nuahce expects their 
system to do on such a test. 

This data point is slightly better 
thah what Nuance expects their 
system to do on such a test. 

Nuance claims: 




For the impostor test, a total of 4,300 trials matched against each other and found an EER of 3%. 

Nuance claimed this is slightly better than their average EER of 3.4% over many such data-sets. For a FAR of 1%, Nuance 
expecfs FRR of 5% (sysfem accuracy of 94%) 

When Nuance repeated the ROC analysis without the user accounts with multiple enrollments, 

the EER remained the same. 

Similarly removing the two most frequent speakers did not affect the EER of the ROC analysis 
speakers did not skew the results. 

In other words, the most frequent 

Note: Speaker adaptation was not enabled during this test. Had this been done. Nuance claims that the EER will decrease by 

25% after 3 calls resulting in a new EER of 1% or system accuracy of 98% and after 6 calls the EER will be reduced by 35%. 


Table 3. NFS Speaker Verification Test Analysis Comparison 
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G. COMPARISON WITH PREVIOUS SPEAKER VERIFICATION TESTS 

USING NUANCE’S TECHNOLOGY 

1. The University of Edinburgh Speaker Verification Test (May 2000) 

The UK Edinburgh test, eonducted in May 2000, elaims 1.2% half total error rate 
(FRR+FAR/2). This eorresponds elosely with the NPS test with a FRR of 2.7% at a FAR 
of 1% yielding a half total error rate of 1.85%. This difference can be explained based on 
the observations in the Edinburgh report reproduced below [26]: 

• The Edinburgh test had more enrollment and verification data (one 
thousand users) as opposed to the NPS trial (68 users). 

• The Edinburgh test's verification error rates were reduced by increasing 
the amount of enrollment data used to train the models for each client 
speaker. For example, training on three utterances of a nine-digit 
membership number instead of on a single utterance reduced the error rate 
by about one-third (from 2.7% to 1.8% with both male and female 
impostors, or from 3.5% to 2.4% with same-sex impostors); comparable 
improvements were obtained on other verification phrases. 

• The Edinburgh test used multiple digit phrases (a nine-digit account 
number, an eight-digit membership number and two single digits) yielding 
an error rate of 1.2% with both male and female impostors or 1.4% with 
same-sex impostors, with speaker models trained on three enrollment 
utterances per phrase. 

• The great majority of the calls made to the Edinburgh speaker verification 
system were made from landline telephones, usually at the participants’ 
workplaces or homes. 
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2, The International Biometrics Group (IBG) Test (2004) 

The IBG test reports a worst-case estimate of a FAR of 0.818% versus an FRR of 
1.04% for landline calls and a FAR of 2.0% versus a FRR of 2.27% for cellular calls. 
This was on a database of 200 callers and the estimates on a second visit after a period of 
4 to 5 weeks (test results provided by Nuance) [27] [28]. 

• Testing occurred in a sterile environment. The room was reasonably 
isolated from external noise. A manually adjustable thermostat controlled 
the room's air conditioning. Air conditioning was set to "off during 
testing, as the climate control fans were sufficiently loud to potentially 
impact testing if they had engaged. 

• IBG used completely matched handsets. Landline testing took place 
through an AT&T Trimline Caller ID Telephone Model 260. Cellular 
phone testing took place on a Samsung SI05. 

• IBG also used three utterances of 16-digits for both enrollment and 
verification. (The NFS test used three utterances of 9-digits for enrollment 
and two utterances of 9-digits for verification.) 

H. TEST LIMITATIONS 

For purposes of this test, participants were expected to be who they claimed to be 
and hence no separate and independent identity checks were planned, either during or 
prior to enrollment. Furthermore, in this test, NFS did not keep records of the type of 
phone lines used, e.g., whether calls were received from landline or cell phone. NFS 
expected to have a random mix of the two. 

Another variable of this test was the number of test subjects. The total number of 
speaker enrollments was 68 speakers; however, only 64 out of the 68 speakers who 
initially enrolled made subsequent calls to the system to verify their voice biometrics (It 
would have been preferable to have at least a 100 enrollments and at least a thousand 
speaker verification attempts). 
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Given the limited scope of this test, gauging how the error rates will scale up for 
the speaker verification technology as the background database grows is difficult. No 
statistics are available for speaker verification against very large voice background 
databases. Nor it is clear what the error rates and accuracy would be for the Arabic 
speaker verification system. NFS can only say that the Arabic speaker verification 
accuracy would be no higher than that for the English speaker verification module. 
Nuance has 13 million English voice models in its database and continues to fine-tune 
speaker verification performance as new data are collected. Presently, they have no 
Arabic voice models in its database system for fine-tuning purposes. 

I. PHASE IB SUMMARY 

In Phase IB of this project, NPS successfully conducted a speaker verification test 
to assess Nuance’s speaker verification technology based on the performance measures of 
the FRR and FAR. During the test, NPS did not impose any restrictions on the callers in 
terms of the type of phone used or from where the calls originated. And while the 
Nuance ROC analysis yields an equal error rate of 3% (FRR based on 411 trials, FAR 
based on 4300 trials) and a system accuracy of 94%, the NPS analysis yields a FRR of 
2.91% and a FAR of 1.2% (based on 411 verification attempts) and a system accuracy of 
95.87%. The ROC analysis equal error estimates of the NPS test are in the same range as 
the average estimates of the equal error rate (FRR = 3.4%, FAR = 3.4% and system 
accuracy = 93.2%) by Nuance based on other similar datasets. This validates the NPS 
test in spite of the smaller number of enrollments and speaker verification attempts. 
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VI. CONCLUSIONS 


A. SUMMARY DISCUSSION 

Speaker verifieation is a viable form of biometrie teehnology and merits further 
researeh. In terms of pereeived applications for operations in Iraq, voice biometrics 
offers unique capabilities that are unmatched in terms of remote-ability, flexibility, 
maintenance and cost. First, voice biometrics uses existing telecommunication 
infrastructures (landline, cellular or VoIP), as such, a new infrastructure is not required to 
be built around the deployment/employment of this technology, which reduces costs and 
time to deploy the technology. Second, voice biometrics allows dissemination and 
collection of information other than key biometric data. Third, voice biometrics can be 
employed in multilingual applications without the aid of a trained linguist or a translator, 
which results in manpower savings. And fourth, voice biometrics rely on a signal that is 
natural and unobtrusive to produce and requires no special user equipment or training, 
which results in the rapid deployment of technology without adding additional training 
requirements for troops serving in Iraq and Iraqi citizens. 

This thesis has documented the results of the NPS research team’s efforts on the 
initial phase of the lEVAP. The intent of this project was to contribute to the future 
employment of speech technologies in a variety of coalition military operations by 
developing a pilot POC system that integrates COTS speaker verification and ASR 
technologies into a mobile platform to enhance warfighting capabilities. 

In Phase IA of the lEVAP, NPS successfully developed a bilingual (English and 
Jordanian-Arabic) speech application that demonstrated the viability of speaker 
verification technology for use in operations in Iraq. 

In Phase IB of the lEVAP, NPS successfully conducted a test to assess the 
accuracy claim of Nuance's packaged speaker-verification application. Nuance Caller 
Authentication 1.0 (for North American English). The NPS test consisted of 68 speaker 
enrollments and 411 speaker verification attempts. Upon completion of the test, NPS 

conducted a single data-point analysis yielding a system accuracy of 95.87%. 
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B. RECOMMENDATIONS FOR FURTHER RESEARCH 

As the preliminary phase of the lEVAP comes to a completion, it is evident that 
the objectives for Phase lA and IB of the lEVAP have been accomplished. However, 
further research is required to achieve the main objective of the lEVAP, which is to 
develop and demonstrate a speaker verification system in Iraqi-Arabic. The following is 
a list of recommended further studies for NPS students in support of this research project. 

• Develop a test to assess the performance of the Iraqi-Arabic speaker 
verification and speech recognition language modules for Phase 1C of the 
lEVAP. 

• Conduct a cost-benefit analysis on the deployment of speaker verification 
technology in Iraq. 

• Conduct a comparative analysis on the communication infrastructure of 
Iraq, e.g., comparison of 802.11, 802.16, cellular, and landline 
technologies in support of the employment of speaker verification 
technology in Iraq. 
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A. BILINGUAL BCCF APPLICATION OVERVIEW 

1, Revision History 

This dialog specification document is produced and controlled by the Naval 
Postgraduate School. All requests to make changes to this document should be directed 
to the authors so that changes are made through the appropriate version control 
procedures. 

2, Typographical Conventions 

• Prompt text in sample dialogs is within quotes and bold (e.g., "May I help 
you?") 

• Verbal responses from the user and sample phrases are within quotes (e.g., 
"Yes.") 

• Natural language (NL) slots are bold and between angle brackets (e.g., 
<name>). NL slots, which are determined by the grammar being used, are 
filled with values based on what the user has said. Sometimes the values 
of NL slots are stored in system variables for later use. 

• Text-to-speech (ITS) output is shown in Italics (e.g., Say-as expr: name.) 
If the TTS value is a literal, it is also placed in quotes (e.g., TTS: "The 
date I heard was.") 

3, Dialog State Format 

A dialog state represents one conversational interchange between the system and 
the user. Dialog states may contain the following elements: 

• Description: Explains what interaction takes place in the dialog state. 

• Special Features: Describes relevant special features, such as whether N- 
best processing is used or the state is a hot-word state and any universal 
behavior (whether there are exceptions, etc.). 

• Entry and Exit States: Eists (as links) the possible preceding and following 
dialog states. 
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• Pre-rec Prompts: Lists the prompts that may he played prior to reeeiving 
the user’s input. 

• Grammar: In a reeognition state, defines the grammar used for reeognizing 
the user’s input hy showing slot names and values. Also shows sample 
phrases that fill the NL slots. The "Sample Phrases" list is not exhaustive. 

• Actions: Lists the actions to he taken hy the system (typically based on 
system variable values). 

• Error Behaviors: If an error behavior for a dialog state differs from the 
application-level behavior, it is noted in this section. 

• State-Specific Universal Behaviors: If a universal behavior (e.g., help) for 
a dialog state differs from the application-level behavior, it is noted in this 
section. 

B. BILINGUAL BCCF APPLICATION SUMMARY 
I. Functionality and Features 

Automated Speech Recognition (ASR) application in support of the voice- 
activated menu-driven application for the Baghdad Central Correctional Facility (BCCF). 

a. DTMF 

Where applicable, callers can use DTMF (touch-tone) to enter such 
information as phone numbers, PINs, dates, and monetary amounts. 

b. Text-to-Speech Output 

Text-to-speech output is used in the application, if needed. 

c. N-Best/Skiplists 

The N-best list is where the recognizer stores not only the result that has 

the highest probability but also N other results in order of decreasing probability. To 

avoid caller frustration and to get more calls put through successfully, the application 

implements a “skip list.” Skip lists are used in combination with N-best lists and store 

items that have been negatively confirmed by the caller. When the caller is re-prompted 

in the same state, items in the N-best list that are present in the skip list are discarded and 
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the application skips over to the next result on the list. If all the results in the N-best list 
are on the skip list, the top choice on the N-best list should be selected. 

N-best lists are also used in conjunction with checksum algorithms (e.g., 
for credit card numbers) and other data sources (e.g., customer databases). Cross- 
referencing the N-best results allows the application to eliminate incorrect recognition 
hypotheses. This technique is often combined with a skip list. 

d. Filler - prefixes, suffixes 

Fillers are incorporated in the grammar before (prefix) and after (suffix) 
the meaningful portion of the sentence. Examples of fillers are: "I want to," "I want," 
"please," "uh," and "um." 

e. Barge-in 

Barge-in is the ability of the system to recognize that a caller is speaking 
while a prompt is still playing, and to stop playing the prompt. Barge-in enables faster 
service for experienced callers who can interrupt prompts, quickly going through the 
dialog. Less-experienced callers are still guided by full prompts. 

f. Randomization of prompts 

Certain prompts that are heard over and over again may have variations 
that are played randomly. For example, the confirmation "okay" might be randomly 
varied with "sure" and "got it." This makes the system more conversational and natural. 

g. Non-recognition States 

Non-recognition states are used mainly in cases where the system needs to 
do data processing, such as sending or retrieving information from the back-end. 
Sometimes these states will also include brief informational prompts that are played back 
to the caller, such as “Sorry, but I was not able to complete your request. Now, hold on 
and I’ll take you back to the Main Menu.” 

In non-rec states, barge-in is off, which means that if a caller says 
something during this state, nothing will happen. Barge-in will be turned back on when 
the caller reaches the next state. 
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h. Task Completion Tags 

For VoiceXML applications, to add more accurate reporting, tasks can be 
labeled with task completion tags in the code to signify a task start and a task end. Where 
appropriate, task completion tags are noted in the dialog spec to be added to the code. 
For example, an end tag might look like this: 

<nuance:taskend name=”accountbalance” cond= “true”/> 

It is important to be careful with tags in the case of factors like “repeaf ’ or 
switching between sub-applications, to make sure the taskbegin and taskend tags match 
up correctly. 

In addition, states in which a task has already been completed (and no new 
task has been started) should override the max error and universals to make sure a task 
end tag is not written, to avoid mis-matched tags. 

L Hot-word 

Hot-word states are used in cases where the system is not expecting the 
caller to say something in response to a prompt, but instead is playing back information 
to a caller. Examples of this include implicit confirmation (’’Okay, fifty dollars.”) or 
general information playback (’’The phone number is: 604 555 1234, and the amount 
owed is fifty-six dollars.”) However, rather than make these non-recognition states, hot- 
word allows the callers to say a small subset of things, such as “no!” or “repeat,” which 
gives the dialog more flexibility. 

In a hot-word state, the prompt is only cut off if the user says something 
within grammar. All out of grammar utterances are ignored and the prompt continues 
playing as if the caller had not said anything. 

Hot-word states generally have small grammars, such as just the 

universals. 

j. VoiceXML Grammar Labels 

A grammar label is automatically included for each state. Grammar labels 
are essential for efficient system tuning. 


64 



2 . 


Users 


It is assumed that the visitors of detainees are between the ages of 18 and 50. 
They eonsist mostly of family members of the detainees, often wives, children, mother, 
and fathers. It is assumed that the visitors are generally repeat visitors. It is also assumed 
that visitors are unfamiliar with the use of speaker verification and ASR technology 

3, Persona 

This is an official Department of Defense (DoD) system; as such a persona of 
professionalism is required. However special attention must be given to the fact that the 
majority of Callers to this system will be the family members of the Detainees, therefore, 
careful consideration of their culture and customs is also a necessity. Additionally, as 
with existing US Correction Facility visitation information system. Callers of this system 
are expected to request directions to the detention facility and will request visitation 
information, such as hour of operations or general visitation procedures. 

4, Variable Definitions 

There are no variables set in this application. 

C. BILINGUAL BCCF APPLICATION DIALOG FLOW 

I, Universal Behaviors 

Certain capabilities and behaviors are available in all dialog states, unless 
otherwise specified. These are called "Universals." 
a. Universal Actions 

The "Universal Actions" grammar is active in all states that have 
recognition. This grammar is typically used to allow callers to ask for help, repeat 
prompts, or transfer to an operator. Examples of expressions and corresponding universal 
NL slot fill values are shown in the table below. The following table shows the 
universals available with the Nuance Voice Platform. These are not necessarily active in 
this application. 
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Universal Values 

Sample Phrases 

cancel 

’cancel’ 


’go back’ 

exit 

’exit’ 


’goodbye’ 

help 

’help’ 

’I need help’ 

mainmenu 

’main menu’ 


’start over’ 

operator 

’Service Representative’ 

’I want to talk with an operator’ 

’agent’ 

repeat 

’repeat’ 


The following table shows the universal behaviors specified in this application. 


Universal Type 

Action 

Goto 

help 

Okay, here’s some help. 

Details: 

help universal “Okay, here’s some 

help.” 

Continue with recognition in 

the state in which the 

universal was spoken. 

repeat 

AND (_previousBehavior == 

undefined) 


Continue with recognition in 

the state in which the 

universal was spoken. 

repeat 

AND (_previousBehavior != 

undefined) 


Throw the event: 

_previousBehavior 

operator 

I’m sorry, there are no representatives 

available. 

Continue with recognition in 

the state in which the 
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Details: 

operator universal “I’m sorry, there are 

no representatives available.” 

universal was spoken. 

exit 


CleanUpAndExitEnglish#say 

Goodbye 

mainmenu 

OK, Let’s start over. 

Details: 

mainmenu universal “OK, Let’s start 

over.” 

LanguageSelection#Language 

Selection 


b. Universal Error Handling 

Universal error handling is outlined below. This error behavior can be 
overridden in any given state. 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Sorry. 

Details: 

global errorl “Sorry.” 

Continue with state-specific 

behavior. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Sorry, I still didn’t get that. 

Details: 

global_eiTor2 “Sorry, I still didn’t get 

that.” 

Continue with state-specific 

behavior. 

WHEN(COUNT = 3) 

nomatch noinput 

maxspeechtimeout 

Sorry, we’re experiencing some 

technical difficulty right now. Please try 

again at a later time. 

CleanUpAndExitEnglish#say 

Goodbye 


Details: 

global_error3 “Sorry, we’re 
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experiencing some technical difficulty 
right now. Please try again at a later 
time.” 


D. BILINGUAL BCCF APPLICATION DIALOG STATES 

This section provides details of the system behavior in each dialog state. 

I, WelcomeBCCF Page Information 

a. Description 

Start page for Baghdad Central Correctional Facility (BCCF) Visitor 
Center Application. 

b. Page Variables 

There are no variables defined for this page. 

c. Call Flow 



2. WelcomeBCCF#WelcomeBCCF 
a. Description 
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Plays welcome prompt to the Baghdad Central Correctional Facility’s 
Visitor Center. (This is a non-recognition processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

- 

LanguageSelection#LanguageSelection 


d. Actions 


Condition 

Action 

Goto 


Hi, Welcome to Baghdad Central Correctional Facility’s 

Visitor Center. Hi, Welcome to Baghdad Central 

Correetional Facility’s Visitor Center. 

LanguageSelection#Langu 

ageSelection 


Details: 

WelcomeBCCF English “Hi, Welcome to Baghdad Central 

Correetional Facility’s Visitor Center.” 

WelcomeBCCF Arabic “Hi, Welcome to Baghdad Central 

Correctional Facility’s Visitor Center.” 



3, LanguageSelection Page Information 

a. Description 

Language selection page, allows callers to continue in either English or in 
Jordanian-Arabic. 

b. Page Variables 

There are no variables defined for this page. 


69 









c. 


Call Flow 



4, LanguageSelection#LanguageSelection 

a. Description 

Prompts users to select a language: English or Arabic. (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

WelcomeBCCF#WelcomeBCCF 

LanguageSelection#EngMainMenu 

LanguageSelection#ArabMainMenu 


d. 


Pre-rec Prompts 
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Type and Condition 

Action 

Entry Type = initial 

To continue in English, say ‘English’. To continue in Arabic, say 


‘Arabic’. 


Details: 

LanguageSelection initEng “To continue in English, say‘English’.” 

LanguageSelection initArab “To continue in Arabic, say‘Arabic’.” 


e. Grammar: LanguageSelection_LanguageSelection.gsl 


NL Slots 

Values 

<language> 

english, arabic 

Sample Phrases 

Slots Filled 

’’english” 

<language enghsh> 

”i’d like to continue in english” 

<language enghsh> 

’’continue in english” 

<language enghsh> 

”uh english” 

<language enghsh> 

’’arabic” 

<language arabic> 

”uh arabic” 

<language arabic> 

’’continue in arabic” 

<language arabic> 

”i’d like to continue in arabic” 

<language arabic> 

’’araabic” 

<language arabic> 

’’arabik” 

<language arabic> 

’’araabik” 

<language arabic> 

’’arabia” 

<language arabic> 

’’araabia” 

<language arabic> 

’’arabee” 

<language arabic> 

’’araabee” 

<language arabic> 

’’araabeah” 

<language arabic> 
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”el arabic” 

<language arabic> 

”el araabik” 

<language arabic> 

”el araabia” 

<language arabic> 


f. Actions 


Condition 

Action 

Goto 

lastresultS .interpretation, la 

Thanks. 

LanguageSelection#EngM 

nguage == “english” 

Details: 

Generic_thanks “Thanks.” 

ainMenu 

lastresultS .interpretation, la 

Thanks. 

LanguageSelection#Arab 

nguage == “arabic” 

Details: 

Generic thanksArabic “Thanks.” 

MainMenu 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 

1) 

nomatch noinput 

maxspeechtimeout 

Please select a language. [SOmsecs] Please select a language. 

[SOmsecs] To continue in English, say ‘English’. [SOmsecs] 

To continue in Arabic, say ‘Arabic’. 

Details: 

LanguageSelection errorEnglish “Please select a language.” 

Silence: 50 msecs 

LanguageSelection errorArabic “Please select a language.” 

Silence: 50 msecs 

LanguageSelection initEng “To continue in English, say 

‘English’.” 

Silence: 50 msecs 

LanguageSelection initArab “To continue in Arabic, say 

‘Arabic’.” 

Continue with rec in 

this state. 
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WHEN(COUNT = 
2 ) 

nomatch noinput 
maxspeechtimeout 


Please select a language. [SOmsecs] Please select a language. Continue with rec in 
[SOmsecs] To continue in English, say ‘English’. [SOmsecs] this state. 

To continue in Arabic, say ‘Arabic’. 


Details: 

LanguageSelection_errorEnglish “Please select a language.” 
Silenee: 50 msecs 

LanguageSelection_errorArabic “Please select a language.” 
Silence: 50 msecs 

LanguageSelection_initEng “To continue in English, say 
‘English’.” 

Silenee: 50 msecs 

LanguageSelection_initArab “To continue in Arabic, say 
‘Arabic’.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

With this system, you have the option to continue in 

Continue with rec in this 


either English or in Arabic. With this system, you have 

the option to proceed in either English or in Arabic. To 

continue in English, say ‘English’. To continue in 

Arabic, say ‘Arabic’. 

state. 


Details: 

LanguageSelection helpEnglish “With this system, 

you have the option to eontinue in either English or in 

Arabic.” 

LanguageSelection helpArabic “With this system, 

you have the option to proceed in either English or in 

Arabic.” 

LanguageSelection initEng “To continue in English, 

say ‘English’.” 

LanguageSelection initArab “To continue in Arabic, 

say ‘Arabic’.” 
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5. 


LanguageSelection#ArabMainMenu 

a. Description 

Link to Arabic Main Menu (This is a subdialog calling the 

ArabicMainMenusubdialog) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

LanguageSelection#LanguageSelection 

- 


d. Actions 


Condition 

Action 

Goto 

- 




e. Inputs to the Subdialog 


Name 

Value 

DATEOUTday 


DATEOUTmonth 


DATEOUTyear 


TIMEOUTAMPM 


TIMEOUTtime 


accountNbr 


enrollmentPin 



6, LanguageSelection#EngMainMenu 
a. Description 
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Link to English Main Menu (This is a subdialog calling the 
EngMainMenusubdialog) 

b. Special Features 

d. Entry and Exit States 


Entry States 

Exit States 

LanguageSelection#LanguageSelection 

CleanUpAndExitEnglish#sayGoodbye 


e. Actions 


Condition 

Action 

Goto 

- 


CleanUpAndExitEnglish#sayGoodbye 


f. Inputs to the Subdialog 


Name 

Value 

DATEOUTday 


DATE OUT month 


DATEOUTyear 


TIMEOUTAMPM 


TIMEOUTtime 


accountNbr 


enrollmentPin 



1. CleanUpAndExitEnglish Page Information 

a. Description 

Clean up and exit in English 

b. Page Variables 

There are no variables defined for this page. 
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c. 


Call Flow 



8, CleanUpAndExitEnglish#sayGoodbye 

a. Description 


(This is a non-recognition processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

LanguageSelection#EngMainMenu 

CleanUpAndExitEnglish#hangup 


d. Actions 


Condition 

Action 

Goto 


Details: 

CleanUpAndExit sayGoodbyeEnglish 

CleanUpAndExitEnglish# 

hangup 


9. CleanUpAndExitEnglish#hangup 


a. Description 
(This is a terminate state.) 
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b. Special Features 


c. Entry and Exit States 


Entry States 

Exit States 

CleanUpAndExitEnglish#sayGoodbye 

- 


E. BILINGUAL BCCF APPENDICES 


1, Grammar and Slot Definitions 


Dialog State 

Grammar 

Slots 

Slot Values 

LanguageSelection#Languag 

eSelection 

LanguageSelection_Languag 

eSelection.gsl 

language 

english, arable, 


2, Prompt List 


Prompt File 

Transcription 

belp universal 

’’Okay, here’s some help.” 

operator universal 

’’Em sorry, there are no representatives available.” 

mainmenu universal 

”OK, Let’s start over.” 

global error 1 

’’Sorry.” 

global error2 

’’Sorry, I still didn’t get that.” 

global_error3 

’’Sorry, we’re experiencing some technical difficulty right 

now. Please try again at a later time.” 

Generic tbanks 

’’Thanks.” 

Generic tbanksArabic 

’’Thanks.” 

CleanUpAndExit sayGoodbyeEnglisb 


WelcomeBCCF English 

’’Fli, Welcome to Baghdad Central Correctional Facility’s 

Visitor Center.” 

WelcomeBCCF Arabic 

’’Fli, Welcoiue to Baghdad Central Correctional Facility’s 

Visitor Center.” 
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LanguageSelection initEng 

”To continue in English, say ‘English’.” 

LanguageSelection initArab 

”To continue in Arabic, say ‘Arabic’.” 

LanguageSelection helpEnglish 

’’With this system, you have the option to continue in 

either English or in Arabic.” 

LanguageSelection helpArabic 

’’With this system, you have the option to proceed in 

either English or in Arabic.” 

LanguageSelection errorEnglish 

’’Please select a language.” 

LanguageSelection errorArabic 

’’Please select a language.” 


F. ARABICMAINMENU OVERVIEW 


1, Application Summary 

a. Variable Definitions 

Application variable information is listed below (if available). 


Application Variables Table 

Name 

Initial Value 

Description 

accountNbr 


another sample variable for the subdialog 

enrollmentPin 



DATEOUTday 



DATEOUTmonth 



DATEOUTyear 



TIMEOUTAMPM 



TIMEOUTtime 




2, Dialog Flow 

a. Universal Behaviors 

Certain eapabilities and behaviors are available in all dialog states, unless 
otherwise specified. These are ealled ‘Universals.’ 

b. Universal Actions 
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The ‘Universal Actions’ grammar is active in all states that have 
recognition. This grammar is typically used to allow callers to ask for help, repeat 
prompts, or transfer to an operator. Examples of expressions and corresponding universal 
NL slot fdl values are shown in the table below. The following table shows the universals 
available with the Nuance Voice Platform. These aren’t necessarily active in this 
application. 


Universal Values 

Sample Phrases 

cancel 

’cancel’ ’go back’ 

exit 

’exit’ ’goodbye’ 

help 

’help’ ’I need help’ 

mainmenu 

’mainmenu’ ’start over’ 

operator 

’Service Representative’ 

’I want to talk with an operator’ ’agent’ 

repeat 

’repeat’ 


The following table shows the universal behaviors specified in this application. 


Universal Type 

Action 

Goto 

help 


Continue with recognition in 

the state in which the 


Details: 

help universal ‘ 

universal was spoken. 

repeat 


Continue with recognition in 

AND (_previousBehavior == 


the state in which the 

undefined) 


universal was spoken. 

repeat 


Throw the event: 

AND (_previousBehavior != 

undefined) 


_previousBehavior 
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operator 


CleanUpAndexitsayGoodby 



eArabic#sayGoodbye 


Details: 

operator universal JjmJ j'J'“ 


exit 


CleanUpAndexitsayGoodby 

eArabic#sayGoodbye 

mainmenu 


ArabicMainMenu#ArabicMai 



nMenu 


c. Universal Error Handling 

Universal error handling is outlined below. This error behavior can be 
overriden in any given state. 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Details: 

global errorl”!^L>“l '0'“ 

Continue with state-specific 

behavior. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Details: 

global error2i lui“ 

Continue with state-specific 

behavior. 

WHEN(COUNT = 3) 

nomatch noinput 

maxspeechtimeout 

(jl JU 

. Jc'd 'jJ 

CleanUpAndexitsayGoodby 

eArabic#sayGoodbye 


Details: 

global errorSi^ 'ij'“ ojl jj luo' ' 
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’’.lic'J j'c*^ 


G. ARABICMAINMENU DIALOG STATES 

This section provides details of the system behavior in each dialog state. 

1, ArabicMainMenu Page Information 

a. Description 

b. Page Variables 

There are no variables defined for this page. 

c. Call Flow 
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2, ArabicMainMenu#ArabicMainMenu 

a. Description 

Arabic Main Menu, enables eallers to get visitation information, get 
directions to BCCF, and use automated scheduling system. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicMainMenu# Arabic V i sitinformation 

ArabicMainMenu#ArabicDirections 

ArabicMainMenu#ArabicVisitInformation 

ArabicMainMenu# ArabicDirections 

ArabicScheduling#ArabicScheduling 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

JJJ cjlJl jJ' 

jL Si_a jjj jjdj lil Ipi “ Jj(_3 jjli-a ‘0 

l3l 5djij 


Details: 

ArabicMainMenu init J j'cscd' Of jJ*“ 

(“Clljiil ljl l|»l “ Jj(_3 C.1^ jJI^ io jIl; jJli-rJ lSl}^ 

.”J jl>= jJI (Jl5 A““ d jij jJ'^ 'uJlLSJj* lsJ' j jl>= jJI (Jl5 A“ j£l(“ UJ 


e. Grammar: 

ArabicMainMenu_ArabicMainMenu.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

information, directions, scheduling 

Sample Phrases 

Slots Filled 
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<userlnput information> 

(_5 JJl” 

<userlnput information> 

(_5 JJ(_>a^ Jl ji” 

<userlnput information> 

”JJL>“jJ' ji=” 

<userlnput directions> 

”JJL>“jJ' ji= S‘-j J^(“” 

<userlnput directions> 

”JJL>“jJ' liesji= L5Jj;. JJL>“^J' j'” 

<userlnput directions> 

’’■^t Jf* 

<userlnput scheduling> 


<userlnput scheduling> 

’’ljJUI j'” 

<userlnput scheduling> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

J® 

ArabicMainMenu#Arabic 

serinput == “information” 

Details: 

Generic sure'^i'^f J»“ 

V isitinformation 

lastresultS.interpretation.u 

Jo 

ArabicMainMenu# Arabic 

serinput == “directions” 

Details: 

Generic sure”^uj-^‘^'^(> 

Directions 

lastresultS .interpretation, u 

Jo 

ArabicScheduling# Arabic 

serinput == “scheduling” 

Details: 

Generic sure”^uj-^‘^'^(> (“^u' J»“ 

Scheduling 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

lio (jJI i_3(^ jla isd^ 

Continue with rec in 

nomatch 

noinput 


this state. 
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maxspeechtimeout 

;Jj[_3 eljjJI 

Jjlj lsJ' 3l^ (It 

5LJi_>a:(jJlLj 1^1 l3l5 

■”■^£1 J(“ :<-Jjl3 



Details: 

ArabicMainMenu error jJ^j> ls6^ JJ»“ 

f“' tiJ' Jj(_>=JcJ' l3l5 

jjl :Jjl3 

lie (_ 5 J 1 Jji_>ajJI 1 _ 3 (^ jia Jl! 0‘-r‘L>“LjJ'‘T 

V' tit/:J jl 3 eljjJl'-j 

?? 59 

■ 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

lio (jJI Jj(_>ajJI jla lsJJ; 4“ 

tiJj; 4 JiiJjfJ' 

isJ^ Jjl>“J[;JJ a‘T‘L>“ijJ'‘T‘ :Jjl3 »'jjJ 

iJjti lio lsJ 

JlS^O^CjJI j>Uaj SlJjjjjjJIlj I^I .”Jji_>ajJl ij^ jia“ 

■”■^£1 Jf :<-Jjl3 

Continue with rec in 

this state. 


Details: 

ArabicMainMenu error lscJj; Jjo-^c^' oj-^J»“ 

JV£i‘^l>“' f*' £HJJ(“4' tiJ' Jj(_>=JcJ' l3l5 

Cljl|ajJ^^ CiJ^ Jjl>“^ JJ Sml>“Uc)^M lsJ^ Jj(_>=jcJ' l5l? 

“^L>“ljJ'‘T‘ V' l5l5 j1=“ :Jjl 3 eljjJll-j 

Jl?^1->“Cj“ ;Jji_3 jJI^ ‘L^jyi Jl;^l>“‘^J' (»'^U 

99 99 

■ ^tJ{‘ 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

^aOaj JLJ^ (jj» jlj^Cj^lJI (jj‘^t^L>“ 

f>cj(jii! Ijl :o(^JIc1jJ 1 cjl 

lil l^al “ :JjJ ‘0 

Continue with rec in this 

state. 
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(Jl5UJ-^J'— 

JI^^Ll!(_>jlJ SLJ(_^jJlLJ l|»l.”Jj(_>ajJ' l3LS : Jj(J jji'-i 

jjli-a ‘(^JIJI :Jjl3 * 

Details: 

ArabicMainMenu_help (/J'J' Ji^jro-ejJI jsj^“ 

1^' Uf* uj'^lso' 

i3lS V' “ 'eijcS *'2 

Jl iji^j^“ :Jjl 3 j(> lsJ^ Jjl>=j 

f^u JV^‘^L>“y “mo'uJ'm '(“'.’’Jja^jJ' 
”.”■^5;j(“ lJlSJl>“‘^“ : JJl3 jJ''-* 


3, ArabicMainMenu#ArabicDirections 

a. Description 

Get directions to Baghdad Central Correction Facility (BCCF). (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicMainMenu#ArabicMainMenu 

ArabicMainMenu#ArabicMainMenu 

CleanUpAndexit_sayGoodbyeArabic#sayGoodby 

e 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

lS'-^ '“lxs-^ s-*20 J;* 

6 fcSJ JL>“J' iJlS ji=J' Jtj' 

jb^Lj jiil Jf. .LJ(_5jljI (_5JI 9 jr J' 1 ”yi,?(“ 18 

(“L>“ UJ-^d“ ‘ijy'j .9 (“l3j 2 JCfd M4-“jus: lsJs c'di-^^yd 

o^lsGJ' lsJ^ UJ-^J'^ 1 *' 1-5 JS ' “ Jf* S.djf'd' esJ^ JjcH=jJI ties A" 
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jjll-j u? ^“lSl>“lSlSjJ' 

Details: 

ArabicDirections_init 20 m lsJj; jc 

jljI S(jcsJ(» j^ lsJj; ”'‘t‘ jj; Uf* .s^i^ 

jljI i_sJI 9 |.(_3j ^ I(>ej 1 Ji^(» 18 6 f>L3J JO'J' iji/ 

(“l 5J CJCr“‘-^ MJUJ <-5^5; 

jjjjtij (>l ls' “j(> 5 ;.l5j(*J' ciJ' Jjl>=jJ^ l5lsJ“ ‘oUD .9 

”>cJ' 


e. Grammar: ArabicMainMenu_ArabicDirections.gsl#Arabic_Rule 


NL Slots 

Values 

<UserInput> 

repeatDirections, retumMainMenu, exitSystem 

Sample Phrases 

Slots Filled 

”Jjl>“jJ' l5l^ ji= j'” 

<UserInput repeatDirections> 

”Jjl>“jJ' l5l^ ji= 

<UserInput repeatDirections> 

”JJl>“jJ' l5l^ ji=” 

<UserInput repeatDirections> 

”ejl|.cScJj; Jjl>“^ J' -^lS j'” 

<UserInput repeatDirections> 

”ejl|» lScJJ; Jjl>^^ J'” 

<UserInput repeatDirections> 


<UserInput repeatDirections> 

”£’(^L>“lSLSJcJ' “f'Ls'tjJ' ciJ' ji” 

<UserInput returnMainMenu> 

’’oi^o^lSlSJcJ' “f'Ls'tjJ'” 

<UserInput returnMainMenu> 

”CJJC” 

<UserInput exitSystem> 

’>'Ju-” 

<UserInput exitSystem> 


<UserInput exitSystem> 
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f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.UserInput == 

“repeatDirections” 


Continue with rec in this state. 

lastresultS. interpretation. Userinput == 

“retumMainMenu” 


ArabicMainMenu#ArabicMainMenu 

lastresultS.interpretation.UserInput == 

“exitSystem” 


CleanUpAndexit sayGoodbyeArabi 

c#sayGoodbye 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

“ Jf* l3l5 

lil .”(_ss jJI'-i iS j^i 

Of>L5^L3J' 

‘’(•Ls'csJ' “ jJI'-j '‘iSOKg'iS jJ^ 

lil 1^1 jJ' 

ljUj;' ji JjiJ e'jjJI'-j 

Continue with rec in this 

state. 


Details: 

ArabicDirections errorAndHelp 

“ Jf* l3L5 

lil lf>i .”i_5j^i s jJI'-s lsj^' 

‘’f'Ls'cjJ' “ Jjti jJI'-j ‘lso^l^Ls jJ^ 

lil 1^1 jjl 

j' fi?'' Jjti *'2 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

» Jf* l3L5 

lil lf>i .”i_5 j^i s jJ^ lsj^' 

0f>LS^L3J' 

‘’f'Ls'cjJ' “ Jjti jJI'-j ’‘LSty^ls jJ^ 
ejjl lil 1^1 jjl ^ 

ji Jjij e'jjJI'-* 

Continue with rec in this 

state. 
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Details: 

ArabicDirections_errorAndHelp '■^1“ 

° Jf' l3L5 

lil lf>i .”i_5J^i Sc-lj;jjli-s csJ^' 
Of>LS^L5J' LsJ^ J' r‘‘^U‘^ 

jJ' “ Jjti 

lil 1^1 jjl 

’’.Ja^JI ji ”0(>IJi_>uJI Jjj jJI^ 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

repeat 


#ArabicDirections 

help 

°jf l3l;A" Si'fO" 

Continue with rec in this 


lil lf>i .”i_5J^i Sc-l^jJ'-s lSj^' 

0f>LS^L3J' lsJ^ J' r‘‘^U‘^ 

‘’f'Ls'cjJ' “ Jjl 3 jJI'-j ‘lSO^l^LS jJ^ 

1^1 i”oL5(_>“L5L5JcJ' 

ji Jjl3 jJI'-* 

state. 


Details: 

ArabicDirections errorAndHelp '■^1“ 

“jf* l3l;S i'fO" oj^J^ 

lil lj»i .”(_sj^i Sjj. :JjJ c-l^jJI'-i l5j^' 

Of>L5^L3J' lsJ^ 

“f'Ls'tiJ' ‘‘ Jjti jJi'-j “tjo^ls 

j>Ll!(_ 50 ej(jl lil 1^1 jl)' 

j' djiJ jJ^A” 



4, ArabicMainMenu#ArabicVisitInformation 
a. Description 


88 










Get visitor information for Baghdad Central Correetional Facility. (This is 
a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicMainMenu#ArabicMainMenu 

ArabicMainMenu#ArabicMainMenu 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

o? “ jG j 

O? i_5jl 

^al ^ Jo _ JcJaJI 

L?' lsJI (“d jd' ofls'idd' djij jdl^-j lS ' .V'^C 

.■t=^d' ijCj;' ji ’’Of'ldc^'d' 


Details: 

ArabicVisitinformation init jf ut/jr l(j^f>d'»jGJ cjIj;1(_)o“ 

ijf“ Cjlj(JoJ1 (jJI (jij^sijCjlJI ^j(_5 j|0 IjljCIj ^ldL>=Ud 

_ joiad^ o^ljIjJI 0^1(_^J1 0 (_ 5 l^J oio t_5d' Jl (jjJjCj Jo 

lj(jjtdcj |oJ lil jd' “(“LsGd' Lsdl o-^j^d' r*' cS^ '“J? ‘^^jd^f'dl 

’’.Ja^d' ij'dj;' ji ”0(>UL>“dl djti e-'j;jdl'-* lS' ,V'^C S?' ‘-^d^ 


e. Grammar: 

ArabicMainMenu_ArabicVisitInformation.gsl#Arabic_Rule 


NL Slots 

Values 

<UserInput> 

repeatMessage, returnMainMenu, exitSystem 

Sample Phrases 

Slots Filled 

”lsj^' ojj> cjl|OjJ^^oJl Gj'” 

<UserInput repeatMessage> 

”Cj 1|0jdj;f>d' 

<UserInput repeatMessage> 
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<UserInput repeatMessage> 


<UserInput repeatMessage> 

jJ' J 

<UserInput repeatMessage> 


<UserInput exitSystem> 

’‘’“iJl^l^IS jJ' »f>Ls'L3J' lsJ' ji” 

<UserInput returnMainMenu> 

’’ci^cyi^ls jjl 0f>LS'L3J' j'” 

<UserInput returnMainMenu> 

‘‘’“I^LyLflS jJ' »f>Ls'L3J' lsJ' 

<UserInput returnMainMenu> 

’’ci^cyi^ls jjl 6f>Ls'lJLJ'” 

<UserInput returnMainMenu> 

”CJJC” 

<UserInput exitSystem> 

’>'Ju-” 

<UserInput exitSystem> 


<UserInput exitSystem> 


f. Actions 


Condition 

Action 

Goto 

lastresultS .interpretation. U serinput == 

“repeatMessage” 


Continue with rec in this 

state. 

lastresultS. interpretation. Userinput == 

“retumMainMenu” 


ArabicMainMenu# Arabic 

MainMenu 

lastresultS.interpretation.UserInput == 

“exitSystem” 


CleanUpAndexit sayGoo 

dbyeArabic#sayGoodbye 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

ojo (_]o 

J<-)' 

: Jjij “ j'(^JJ 'm 

V' -"cS 

Continue with rec in this 

state. 
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: JjJ >' 2 ^jJ' »f>Ls'L3J' lsJ' 
ocjjl lil 1^1 jJ' (jf 

ji ”0j»lJ(_>:JI Jjlj jJll^ 

Details: 

ArabicVisitInformationerrorAndHelp 

Of>LS^L3J' lsJ^ JC 

lJ ^‘LfO^lS jJ' 

(jJ^Cieij iJjti “J'if JJIm 

UJ-^J^ '(*' ' ® J(^ 

: JjJ jJ'‘-“ jcJ' »f>Ls'L3J' lsJ' 

Of' f'‘^i^o'^0' V jJ' »f'LS'L3J“ 

ji ”0j»lJ(_>:JI Jjlj jJI^ 

WHEN ( COUNT = 2) ‘j? jJ^f'J' lsJ' J' Oj-^ J» Continue with rec in this 

nomatch noinput oflsIJJ' ‘•^ Oj-^ f*' lS jc^ state, 

maxspeechtimeout tiJ^ Jji>=>^ J' uj-^r'‘^0'^ ’^‘‘l^o^Ls jJ' 

: Jjti jJl‘-“»j'(^jJ'M 

Oj-^j*^ t'‘^0^ V' ■”‘■5' “Jf* -^^1“ 

: JjJ jJ'‘-“ jJ' “f'Ls'iiJ' lsJ' 

JI «|at^ljj“ ij^ lil 1^1 j 

ji ”l>j»lJ(_>:JI Jjlj >lj jjll^ 

.■1=^JI LjlJj;' 

Details: 

ArabicVisitInformationerrorAndHelp 

0 ^ dil^jJ^^JI oio f_5jl ^I^Cljf_^lJl fjjJjdj Jo‘‘ 

Of'csIiOJI lsJI “-^j^JI Oj-^j'^ JC 
^Jl OJ-^J'^ f'‘^0‘^ 1^1 ‘^■‘LfLyLflS jJI LsJ^ Jjl>= 

: Jjti ^ij:jJl‘-“ “j'l?JJIm '^VjJ^t' 

“■^jJ^JI Oj-^j'^ t'‘^0^ 1^1 Vi .’’csj^ i °jf' -^^1“ 

: JjJ ^l^:jJI‘-“ ‘oi^u'^i/LsjJI “f'Ls'iiJI csJI 

0? f'Cji^oCjfjl lil 1^1 .’’‘'LfO^lS jJI »f'L5'L3J“ 
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ji Jjlj >1^ jJI^ 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

repeat 


#Arabic V isitlnformation 

help 


Continue with rec in this 


»jl(/ -Jjls 

V' '"csi “jf* 

: Jjti jJl'-i ‘olso^lsIsjl)' “(“Is'LiJ' lsJ' 
a? f>cj(^c.cjjl lil Ipi jJ' “f>Ls'L3J“ 

ji ”0(>IJ(_).:JI Jjlj jJI^ 

liUj;.' 

state. 


Details: 

ArabicVisitlnformation errorAndHelp 

Jo“ Sj^a ojo 

VCS'cSJ' LsJ^ J' CS I 

lsJ^ ^‘L^O^iS jJ' 

: Jjij JJ'm 

V' '"cS i “ Jf* 

: Jjti jJl'-i ‘olso^lsIsjl)' “(“Is'LiJ' lsJ' 
Cji^oCjjjl lil l^i .’’ocSO'csLS jJI »(>c5'l5J“ 0 ? f* 
ji ”0(>IJ(_).:JI ^(a“ Jjlj jJI^ (al^Cj^aJliilia 



5, ArabicScheduling Page Information 

a. Description 

This page simulates the Nuance Caller Authentication (NCA) Process. 
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b. Page Variables 


Page Variables Table 

Name 

Initial Value 

Description 

AcctNbr_a 



AcctNbr_b 



AcctNbr_c 



AcctNbr_d 



AcctNbr_e 



AcctNbr_f 



AcctNbr_g 



AcctNbr_h 



AcctNbr_i 



AcctNbrJ 



EnrollPin a 



EnrollPinb 



EnrollPin c 



EnrollPind 
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c. 


Call Flow 
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6, ArabicScheduling#ArabicScheduling 


a. Description 

Ask callers if they are enrolled in the automated scheduling system. 
(This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicMainMenu#ArabicMainMenu 

ArabicScheduling#V oice V erification 

ArabicScheduling#VoiceEnrollment 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

.ijJ 1^1 Co d® Co 

Cl JjiJ «lj L5‘-“ 

l”IJ“ Jj(_5 c-l^ jJIl-a (^JIJI (»d=(j 'L3‘T‘L>f (* ^L>“ 

.f'ltajJI Co (^i_a (Ji_a IjjjjjLj 


Details: 

ArabicScheduling init Jjrl 0 , 0 “ 

Jo .|oL]a (jjl Co o' 

ol^jjllj I^JIJI J(^J(J^C1 jJI joUajj l(_ 3 LJ(jOj> ^CjJ^ijo J (_3 Cl Vj>Lloi(jJI Co 

joJ Cl .”(>5;.u“ Jjti (^dU^ dcs^ij^^^dl jodij 1 ^ cioj 

”.f‘doi(jdl l5‘-* lS'-® u^uj ‘”U“ djJ jd'^ 


e. Grammar: 

ArabicScheduling_ArabicScheduling.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

yes, no 
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Sample Phrases 

Slots Filled 

”IJ” 

<userlnput no> 

59 - .99 

<userlnput yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS. interpretations 

serinput == “yes” 

Details: 

Generic thanks” 1 

ArabicScheduling#Voice 

Verification 

lastresultS.interpretations 

serinput == “no” 

Details: 

Generic thanks” 1 

ArabicScheduling#VoiceE 

nrollment 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Jjii jJl'-i 

a^oj ”U“ JjJ ''CJc? 

.(•dajJI lio (^l_a 

Continue with rec in this 

state. 


Details: 

ArabicScheduling error 

j .’V^u“ J jl 3 f 

' joj^^ (>J »J'^ jJ'i-j LiLsJja^ (> 

IjjjjLJ ”IJ“ Jj(_5 

lio ij‘-i 


WHEN(COUNT = 2 ) 

nomatch noinput 

maxspeechtimeout 

Jjti 

U(/JjL>“ f* ' (“J »J'^ J ”?'co‘' 

”U“ Jjl3 ''CJc? CjC^J 

Continue with rec in this 

state. 
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.(•LliijJ' l5‘-“ 

Details: 

ArabicScheduling_error 
j Jjl3 

jjli_a U(/JjL>“ f* '(“J 

(^l_i IjjjjLJ ij^ijj ’’IJ" Jj(_3 

”.t“d=(jjl lio iS'^ 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

o' (“'t=0 Jj' 0(“ 

Continue with rec in this 


lil lj« iji-1 Oi^d^L>“f' 'jOj*^*— 

V djlj (/J'J' (“d=0 iS^ 'L3‘T‘L>“f‘ 

LS J'J' fdiO LS'-^ (* ^L>“ \3 'j0j‘^‘^ (>L. 

lS'-* (»^-^^'l>‘Ol>‘ 'Ojj-^M O^Oj ‘”'J“ JjJj *'2 jJ''-' 

.^aUajjtJl 1 jo 

state. 


Details: 

ArabicScheduling help d/jro^ejjl J^I j^o“ 

lio iji-s l(_5uj(jjj» OL5L]jL>“f‘ 'j0j‘^‘^ o' ‘(/J'J' 

l5‘-* 'ijMij'f' t'‘^0‘^ '^' .t'd=oJ' 

jfj lil l|ol Jj(j lsJIJI 

OcOj ‘”'J“ Jjti lsJ'J' (odinj iji-i 

”.(*d=oJ' Jl;2;l>“‘^J' l5‘-* (“^-^j^'o^Oo" 'Ojj-^m 



1. ArabicScheduling#ConfirmAccountNbr 

a. Description 

This process asks callers to confirm their 10-digit aecount number. 
(This is a recognition state.) 

b. Special Features 
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c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#VoiceEnrollment 

ArabicScheduling#VoiceEnrollment 

ArabicScheduling#EnrollmentPin 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

File Expression] [File Expression] [File Expression] [File[ J» 

Expression] [File Expression] [File Expression] [File Expression] [File 

Expression] [File Expression] [File Expression] 

[SOOmsecs] J .’VS.O“ Jjii ‘ f 

.”IJ“ Jjj jjli-s 

Details: 

GenericPromptConfirm_part 

File Expression: ’’numbers/” + AcctNbr a + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr b + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr c + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr d + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr e + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr f + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr g + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr h + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr i + “ high.wav” 

File Expression: ’’numbers/” + AcctNbrj + “ high.wav” 

GeneriePromptConfirm_part2 ^ 

Silence: 500 msecs 

GenericPromptConfirm yesNo 0“ Jjii J'-l''-* 

Jji_3 ‘ 


e. Grammar: 

ArabicScheduling_ConfirmAccountNbr.gsl#Arabic_Rule 
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NL Slots 

Values 

<userlnput> 

yes, no 

Sample Phrases 

Slots Filled 

”IJ” 

<userlnput no> 

59 - .99 

<userlnput yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

l(jl 

ArabicScheduling#VoiceE 

serinput == “no” 

Details: 

Generic imSorry”!‘-iL)'l 'ij'“ 

nrollment 

lastresultS.interpretations 


ArabicScheduling#Enroll 

serinput == “yes” 

Details: 

Generic_great”-iL5jr“ 

mentPin 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

URL[ (jiul lii 

Continue with rec in this 

nomatch noinput 

Expression] 

state. 

maxspeechtimeout 

‘ 0‘^ls (“cJ c]jl5 

.”1J“ Jjj C.1^ 



Details: 

ConfirmAccountNbr errorlj'“ (>l 3 J 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo u'*^ 

c)jl 3 jJI'-j ‘ 
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Jjij jjli-j ‘ 


WHEN(COUNT = 2) 

URL[ 

Continue with rec in this 

nomatch noinput 

Expression] 

state. 

maxspeechtimeout 

‘ O'^ls (“J 

.”IJ“ Jj(j c-l^ jJI^ 



Details: 

ConfirmAccountNbr error (“lij 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo u'*^ 
j>J lil 0 jl 3 jJI'-j ‘ 

”.”IJ“ JjiJ jJIl-j ‘ 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 


Continue with rec in this 


URL[ (“cSJ 

Expression] ‘ 

state. 


‘ 0*^1/ {“cJ LI .”(^^ 0 “ Jjti 

.”IJ“ Jj(j c-l^ jJI^ 



Details: 

ConfirmAccountNbr help j' j'“ 

1 jjltSl lil i^j(_pajLJ (^L)C)' Of' 

”'OlSJJ f“^M'L>“C f'OJ 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo O'*^ Ll“ 
lil .”|a^O“ Jjl3 ‘ 

”.”IJ“ Jji_3 jjll-* ‘ L» 
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8, ArabicScheduling#ConfirmAccountNbr2 


a. Description 

This process asks callers to confirm their 10-digit account number. (This 
is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling# V oice V erification 

ArabicScheduling#VoiceVerification 

ArabicScheduling#NbrCountV erify 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

File Expression] [File Expression] [File Expression] [File[ ^^^ 0 “ 

Expression] [File Expression] [File Expression] [File Expression] [File 

Expression] [File Expression] [File Expression] 

(_>= r“J Jjl 3 ‘ .”'J“ Jjti *'2 ‘ 

Details: 

GenericPromptConfirm_part 1 o" 

File Expression: ’’numbers/” + AcctNbr a + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr b + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr c + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr d + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr e + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr f+“ high.wav” 

File Expression: ’’numbers/” + AcctNbr g + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr h + “ high.wav” 

File Expression: ’’numbers/” + AcctNbr i + “ high.wav” 

File Expression: ’’numbers/” + AcctNbrJ + “ high.wav” 

GenericPromptConfirm_part2 

GenericPromptConfirm yesNo .’’(“Jiu" JjJ ‘ 
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e. Grammar: 

ArabicScheduling_ConfirmAccountNbr2.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

yes, no 

Sample Phrases 

Slots Filled 

”U” 

<userlnput no> 

?5 ^ .99 

<userlnput yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

l(jl 

ArabicScheduling#Voice 

serlnput == “no” 

Details: 

Verification 


Generic imSorry’^i-ii^"^ ' 0 '“ 


lastresultS.interpretations 


ArabicScheduling#NbrCo 

serlnput == “yes” 

Details: 

untVerify 


Generic_great”-iL5jr“ 



g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

URU[ fcSj 

Continue with rec in this 

nomatch noinput 

Expression] ‘ 

state. 

maxspeechtimeout 




.”IJ“ Jjij elj jjli-j 



Details: 
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ConfirmAccountNbr error fiij 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo 

f'J 3jiJ jJ'*-* ‘ 

Jj(_3 ‘ 0^14 


WHEN(COUNT = 2) 

URE[ (“csj 

Continue with rec in this 

nomatch noinput 

Expression] ‘ 

state. 

maxspeechtimeout 

‘ 3jij 

.”IJ“ Jjj jjli-j 



Details: 

ConfirmAccountNbr error fiij 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo 

f'J 3jiJ jJ'-j ‘ 

”.”IJ“ Jjj jJI^ ‘ lJ^lS 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

f“L3J (jj> Jlilldll jl jl 

'jo u'*^ 'j' JURE Expression[ 

Jjij o'j jJ''-* ‘ r“3 'j' .’V&cJ^ Jjl3 

.”'J“ 

Continue with rec in this 

state. 


Details: 

ConfirmAccountNbr help (^ 00 ' 0;“ O' V j'“ 

^ijj jjlli! lil 

URL Expression: genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo 'j® O'*^ 'j'“ 

Jjii ‘ ij^L? (“J 'j' 3jl3 jJ'‘-“ 
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9, ArabicScheduling#ConfirmEnrollPin 

a. Description 

This process asks callers to confirm their 4-digit enrollment PfN. (This is 
a reeognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#EnrollmentPin 

ArabicScheduling#EnrollmentPin 

ArabicScheduling#EnrollCheck 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

File Expression] [File Expression] [File Expression] [File[ J» 

Expression] 500[ J»msecs] Jjii ‘ 

.”1J“ Jj(j c-lj‘ lil .”^^ 0 “ 

Details: 

GenericPromptConfirm_partlf>a“ 

File Expression: ’’numbers/” + EnrollPin a + “ high.wav” 

File Expression: ’’numbers/” + EnrollPin b + “ high.wav” 

File Expression: ’’numbers/” + EnrollPin c + “ high.wav” 

File Expression: ’’numbers/” + EnrollPin d + “ high.wav” 

GenericPromptConfirm_part2”^^L5^L>=‘ J»“ 

Silence: 500 msecs 

GenericPromptConfirm yesNo Jjii ‘ *d'“ 

Jji_3 jjll-s ‘ 'do f'd 'dl 
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e. Grammar: 

ArabicScheduling_ConfirmEnrollPin.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

yes, no 

Sample Phrases 

Slots Filled 

”IJ” 

<userlnput no> 

59 - .99 

<userlnput yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

l(jl 

ArabicScheduling#Enroll 

serinput == “no” 

Details: 

Generic imSorry”!‘-iL)'l 'ij'“ 

mentPin 

lastresultS.interpretations 


ArabicScheduling#Enroll 

serinput == “yes” 

Details: 

Generic_great”-iL5jr“ 

Check 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

URL[ (“lij 

Expression] ‘ 

.”1J“ Jjj C.1^ 

Continue with rec in this 

state. 


Details: 

ConfirmEnrollmentPin error ul>d lil“ 

URL Expression: 
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genEnrollNumber(enrollmentPin) 

GenericPromptConfirm yesNo 

lil ‘ 

Jji_3 elj jjli-* ‘ CJ^lS 


WHEN(COUNT = 2) 

URL[ (“lij 

Continue with rec in this 

nomatch noinput 

Expression] ‘ 

state. 

maxspeechtimeout 

‘ (“J Jjti 

.”IJ“ Jjj el^ jjli-a 

Details: 

ConfirmEnrollmentPin error ul>^ 1 

(>l3J 

URL Expression: 

genEnrollNumber(enrollmentPin) 

GenericPromptConfirm yesNo u'*^ 

lil Jjl3 ‘ 

”.”IJ“ Jjij elj jjli-j ‘ 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

(“lij i^Cx} o' Of* 

Continue with rec in this 


(“l3J 

'il JURE Expression[ 

j>J lil Jjti jJI'-j ‘ 

.”IJ“ Jjj el^ jjli-a 'if 

state. 


Details: 

ConfirmEnrollmentPin help lsuL’^"" 

(“l3J lSoO' u' Uf 

URL Expression: 

genEnrollNumber(enrollmentPin) 

GenericPromptConfirm yesNo u'*^ 'i'“ 
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”.”IJ“ Jji_3 elj jjli-* ‘ ij^l/ 


10, ArabicScheduling#EnrollCheck 

a. Description 

This process asks callers if they would like to “enroll me now.” For 
demostration purposes, linsk to additional verifieation information is not ineluded in this 
applieation. (This is a reeognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#ConfirmEnrollPin 

ArabicScheduling#NbrCountOne 


d. 

Pre-rec Prompts 

Type and Condition 

Action 

Entry Type = initial 

lie iji}^ <—1 lljJI jLJ Ijjjl 

jCjlilij ^jkJI ,c.jo Jia ejjjjJaJI 0 ? 

ojA^ ^jO“ “l3l 5. jL>“d^ “(“Jal jl =l3l5 jA Uf* 

ok kiji-i oJ^lj _o1 lS^IJ .loalj^o “l3lS 

.”LSd)Jj[;L>‘“ :djL3 jd ‘' JJ'-* 


Details: 

EnrollCheck init j.Lkju j»alJjro-u (»J 'uu'' 

tit/ uj;. lsJ^ Of* 'u “As 

“As j 1=J' . jo^JI Ojojal jl jijoJI “AsA .“csd^ ^ 

'JlsJls “l3l5j1=J' jf'J Afi? ojAl^ 

’’.’’cSjjdjo"^ :Jjl5 jJ' ‘' jj‘-“ ls^IJ 
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e. Grammar: ArabicScheduling_EnrollCheck.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

enrollMeNow 

Sample Phrases 

Slots Filled 


<userlnput enrollMeNow> 


f. Actions 


Condition 

Action 

Goto 

lastresultS. interpretations 

serlnput == 

“enrollMeNow” 

Details: 

Generic thanks” 1 


— 


ArabicScheduling#NbrCo 

untOne 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

:Jjl5 jJ' ‘ 

Continue with rec in this 

nomatch noinput 

’VuJsia-" 

state. 

maxspeechtimeout 

Details: 

EnrollCheck errorAndHelp 

:Jjl3 jJ' 


WHEN(COUNT = 2) 


Continue with rec in this 

nomatch noinput 


state. 

maxspeechtimeout 

Details: 



EnrollCheck errorAndHelp 



:Jjl3 jJ' 
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h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 


Continue with ree in this 


’’cSuJjro'" 

state. 


Details: 

EnrollCheck errorAndHelp 

:Jjl3 



11, ArabicScheduling#EnrollmentPin 

a. Description 

This process asks caller for his or her 4-digit enrollment PIN. (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#ConfirmAccountNbr 

ArabicScheduling#ConfirmEnrollPin 

ArabicScheduling#ConfirmEnrollPin 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

J Jf*jj J&d) o'd "OCcJ 

Jjl3 (-^ z d)fj jJI aljjj ItiJIjj.:jl j»cj cscjjl 

jJ jiji ji 

Details: 
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EnrollmentPin init' ■-*u'J jfjJ (“'lij' j'J 

jJI liljij jl ^ lo 

j? jJ f'ljj' j'cJ' j' JjJj *'2^je)' U(*j 

Entry Type = reentry 

• LSJ^ ' “Jl» jJ S^LjjlJI jl Jjij e'jjJ' 

Details: 

EnrollmentPin reentry jf -jJ f>ljj' j'cJI j' Jjii jJ'“ 

Sjj> 


e. Grammar: ArabicScheduling_EnrollmentPin.gsl#GetPinNumber 


NL Slots 

Values 

<enrollPin> 

” [four-digit-string] ”, 1 j-oljjejLcejlJdj-ojl 

<digit_one> 

Ij ^jt_aLH=6^L>“ej ^c.(_5(jl|aej )“£l^ 

<digit_two> 

,6ejljej ,(jl(j4jl ,j-^o^ 

<digit_three> 

,6ejljej ,(jl(j4jl ,j-^o^ 

<digit_four> 


Sample Phrases 

Slots Filled 


<digit_one ■^^'j> 

<digit two u'u‘^'> 

<digit three o‘4jlJej> 

<digit_four 

<enrollPin jl 

”dtmf-l dtmf-2 dtmf-3 dtmf-4” 

<digit_one ■^^'j> 

<digit two '>(j'o‘^ 

<digit three o‘4jlJej> 

<digit_four 

<enrollPin j-olo‘^FodjlJ2j->o^tjjl 
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f. Actions 


I^ondition 

Vction 

joto 


Details: 

Generic thanks”' j^u^“ 



Assign: EnrollPin a = 

lastresult$.interpretation.digit one 

Assign: EnrollPin b = 

lastresult$.interpretation.digit two 

Assign: EnrollPin c = 

lastresult$.interpretation.digit three 

Assign: EnrollPin d = 

lastresult$.interpretation.digit four 

Assign: enrollmentPin = 

lastresult$. interpretation, digit enrollPin 

ArabicScheduling#Confir 

rnEnrollPin 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

j? jj “^4-“ jU' j' Jjl3 jj' 

Details: 

EnrollmentPin errorAndHelp jJ'“ 

jJ f' l3j' j'J' -1=5;l>^ j' Jjij 

Continue with rec in this 

state. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

IJ jJI jJ jlJI j' Jj 

Continue with rec in this 

state. 


111 












Details: 

EnrollmentPin errorAndHelp jJ'“ 
jj*jJ j'J' j' Jjl5 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

jf>jJ f'ijj' jU' j' Jjti jJ' 

Continue with rec in this 



state. 


Details: 

EnrollmentPin errorAndHelp jJ'“ 

jf-jJ f' l3j' j'J' j' Jjij 



12, ArabicScheduling#NbrCountOne 

a. Description 

This process asks callers to count from 1 to 9. (This is a recognition 

state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#EnrollCheck 

ArabicScheduling#NbrCountTwo 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

jf ‘9 lsJ' 1 a? 2f'£l 

^ j l-i^ csJIJl f>Lla(jJI 
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.0^(_>ol 1! j»(j3J (jJI iodjlJdj 

Details: 

NbrCountOne_init ‘9 lsJ' 1 Of J' 'jjj' V‘^‘-^ ‘-^c' Of“ 

‘-jjL>“ LSJ^ Of (/Jl(“tlinjjl 0(^JlejCjja ^eljlJ|» 

^LJ |atlljl(jinj f^^Of loLjJLeljjj lS^jJI Ji_>«jl (_pa 

;|jltll» i 9 ciJ' 1 Of °-•(“ ‘lj'cJ' .f^^lJO^^Ly Of 

”.a^o^Oj |.jj (_sJI i»ejljtli i(jljjdjli 


e. Grammar: ArabicScheduling_NbrCountOne.gsl#Arabic_Rule 


NL Slots 

Values 

<uselnput> 

nbrCount 

Sample Phrases 

Slots Filled 


<uselnput nbrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresult $. interpretation. u 

seinput = “nbrCount” 


ArabicScheduling#NbrCo 

untTwo 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

1 Of 3 '“Of ‘.J'j; 

^(Jjj (jJI ioCLilJej J i9 tsJI 

Details: 

NbrCount error 

jliiilo i9 lsJ 1 Of' “ jt* ‘.3^^ 

Continue with rec in this 

state. 
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lodlljd! 


WHEN(COUNT = 2) 


Continue with rec in this 

nomatch noinput 


state. 

maxspeechtimeout 

(JjlIi .0^ 



Details: 

NbrCount error p jo^ 

jliiilo i9 lsJ 1 Of' Jt* 

”.o^(_>oCj j»jj (_sJl lodjIJdj 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

e'j’jJI JO^ dj;' O? 

Continue with rec in this 


‘9 c^J' 1 Ljf j jf" sJ'j;. 

state. 


Details: 

NbrCount help df't 0 (““ 

‘,dl^ jJI 

49 1 (j^ o.i^lJ oj^ 

j>jj ,_5J1 iodjIJdj 



13, ArabicScheduling#NbrCountThree 

a. Description 

Number count three for voice model collection. (This is a recognition 

state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabieScheduling#NbrCountT wo 

ArabicScheduling#RecordSecretDate 
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d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

lSJc' "“"jt* 


Details: 


NbrCountThree inif’^f'^Jo^'-* 0? lS jc' 


e. Grammar: ArabicScheduling_NbrCountThree.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

nbrCount 

Sample Phrases 

Slots Filled 


<userlnput nbrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 


ArabicScheduling#Record 

serinput == “nbrCount” 


SecretDate 


Details: 



Generic_great”-iL5jr“ 



g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 


Continue with rec in this 

nomatch noinput 

f‘L3J CiJ' ieCjlcJ-lj ijjljjClllt J t9 

state. 

maxspeechtimeout 




Details: 

NbrCount error 

;|jUlo i9 csJ 1 Of' *Jf' 

(_5JI i(jl 
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WHEN(COUNT = 2) 

1 (jf ° jJ' 

Continue with rec in this 

nomatch noinput 

f‘L3J CiJ' J t9 

state. 

maxspeechtimeout 




Details: 

NbrCount error 

pjalo i9 lsJ 1 Of' Jt* 

(»l5j LsJ loCjlJdj 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 


Continue with rec in this 


j '• Jf* ‘.J'j; ‘9 lsJI 1 Of' 

state. 





Details: 

NbrCount help 

‘9 1 U* o.i^lJ oj^ 

j>jj ,_5J1 lodjIJCj 



14, ArabicScheduling#NbrCountTwo 

a. Description 

Number count two for voiceprint collection. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabieScheduling#NbrCountOne 

ArabicSeheduling#NbrCountThree 
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d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

ijf> lSJc' 


Details: 


NbrCountTwo init’Tj.iilJi_>:=i-i q? lS jc* -Jc'^ j“ 


e. Grammar: ArabicScheduling_NbrCountTwo.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

nbrCount 

Sample Phrases 

Slots Filled 


<userlnput nbrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

serinput == “nbrCount” 


ArabicScheduling#NbrCo 

untThree 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

1 o? J 

Continue with rec in this 

nomatch noinput 

(“l3J lsJ' ‘9 csJ' 

state. 

maxspeechtimeout 




Details: 

NbrCount error p 

;|jUio i9 csJ 1 Of' Jf 

oCjlJcj (_5JI i 


WHEN(COUNT = 2) 

1 ij(“ °‘.cJ'j; f-'j’jJI 

Continue with rec in this 
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nomatch noinput 


state. 

maxspeechtimeout 




Details: 

NbrCount error 

i9 csJ 1 Of' “Jf 

(>(JJ lSl!' ioCjIJCj 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

‘f“^J jl >^ cJf' 

q. oJj-lj S‘9 tiJ' 1 

toCjlJcj t j 

Continue with rec in this 

state. 


Details: 

NbrCount help ‘4““ 

‘9 1 J 

(»l5j LsJ loCjlJdj 



15, ArabicScheduling#NbrCount Verify 

a. Description 

Number count for voice verification. This process asks callers to count 
from 1 to 9. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#ConfirmAccountNbr2 

ArabicDetaineeAppt#ArabicDetaineeAppt 


d. Pre-rec Prompts 
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Type and Condition 

Action 

Entry Type = initial 

i9 1 JcJ' J(J-a JtiiiCjJJ 

jj i_$Jl lodjlJdj 4 jl j 


Details: 


NbrCountVerify init's jo^ 

ieClilJCj ijjljjCliltt9 1 


e. Grammar: ArabicScheduling_NbrCountVerifiy.gsl#Arabic_Rule 


NL Slots 

Values 

<uselnput> 

nbrCount 

Sample Phrases 

Slots Filled 


<uselnput nbrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

seinput = “nbrCount” 

jjj> J lilldjJI j>Clj 

Details: 

NbrCountVerify_post oj* 

jJ^f J' 

ArabicDetaineeAppt#Ara 

bicDetaineeAppt 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

1 j jf* ‘.J't, 

Continue with rec in this 

nomatch noinput 

(JJ' ‘et-liljuj ijjljjClilt J t9 tjJ' 

state. 

maxspeechtimeout 




Details: 
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NbrCount error p 

'J Uiiio t9 1 Uf* 

(*l5j Lsd loCjlJdj 


WHEN(COUNT = 2) 


Continue with rec in this 

nomatch noinput 

f‘L3J CiJ' ieCjlcJ-lj tjjljjClllt j t9 

state. 

maxspeechtimeout 




Details: 

NbrCount error p 

i9 csd 1 Of' ‘ jf' 

(*(JJ LSJ IoCjIJlI! 



h. State-Specific Universal Behaviors 


Universal Type 

Aetion 

Goto 

help 

juSIcjJJ 

Continue with rec in this 


i9 l5<J' 1 

i_jjl lodjlJdj 4 jl j 

state. 


Details: 

NbrCountVerify help Of 

‘9 1 j 

j>JJ ,_5J1 lodlljd! 



16, Ar abicScheduling#RecordReminder 

a. Description 

This process simulates the NCA process of recording a callers’ hint to 
their secret date. For demostration purposes, this recording is not saved to any backend 
database. (This is a record state.) 

b. Special Features 

c. Entry and Exit States 
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Entry States 

Exit States 

ArabicScheduling#RecordSecretDate 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

(j^OJ OlSJO^JI Jjlj jjl .L5 Jlilidj 


Details: 

RemindDate init jo^JI 1 jj^jcjCj jjI j itjljl“ 

Jjl3 jJI -if jL>“J' i^cjjl 

'“ 5 ; Vo* IjjjjJu O^OJ 0(5J(5oJ' 0|»JiilJI 


e. Actions 


Condition 

Action 

Goto 

- 

■^(jJ ‘ '(j(Jo^ (odajLJ (^(_i (“>^2(52(5“^^ 

CleanUpAndexit sayGoo 


.Cjj(_>aJI ijd^ (-a j^CjJI 

dbyeArabic#sayGoodbye 


Details: 

RemindDate_post j>‘^J(5jL>“^ ‘ '(jL>“c“ 

”.‘^j(>=J' lSl}^ fdinjLj iji-i 



f. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

of-Jo^JI i^d (j' Jo ‘ J 

Continue with rec in this 

nomatch noinput 

Jiilidj (^(_i (5CjJI 0(^jijoJI 

state. 

maxspeechtimeout 

J(5oJl 



Details: 



RemindDate error (jl Jo I'CI^j“ 
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WHEN(COUNT = 2) 

IjJjjdj jjl J« 11*1^ j 

Continue with rec in this 

nomatch noinput 


state. 

maxspeechtimeout 




Details: 

RemindDate error o' J» ‘ '»'(r j“ 

tnj jo^JI «|»Jtl3Jl J IjJjjcj 

l 5 jalidj 



17, Ar abicScheduling#RecordSecretDate 

a. Description 

This state is an Arabic subsitution process for the English GetSecretDate 
and ConfirmSecretDate processes. (This is a record state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#NbrCountThree 

ArabicScheduling#RecordReminder 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

j (_sJI Jjcjj(j l_Sji_>0 

l5 jj; J ‘ dai-a^ J oo^cS l3J“J ‘ Jl Ji ji_>0 Jl 

“JjJj jd' ‘UlS J^f Cxf 

.1998 Jo jm' Of J j'J': 'J‘^f' ‘0(jL>“J' 

Details: 
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RecordSecretDate_init tiJ' jd^ cs^“ 

f“^L5J^ J ‘’L>“LS C*;? lSJ^'^LS J“J Jl jo^jl (“^JlL>‘lj ‘-“JL>“J “L5 Jl>“J' 

jJI '■CXf JC? tA?LS cJ^ ‘ dalj^ 

j> J jiJI: ‘»(jL>“J' “Jjl3”.1998 CiLf jm' o 


e. Actions 


Condition 

Action 

Goto 


Details: 

Records ecretDate_post 

”lSJl>“JI J|»jl 

ArabicScheduling#Recor 

dReminder 


f. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

jf>JI JJt3 e-lj; jJI 

Continue with rec in this 

nomatch noinput 

maxspeechtimeout 

Details: 

RecordSecretDate error 

”lS J(>c)I 

state. 

WHEN(COUNT = 2) 

lSJl>“c)I ^ jfJ' Jjij jJ' 

Continue with rec in this 

nomatch noinput 

maxspeechtimeout 

Details: 

RecordSecretDate error 

”lSJ(» jl 

state. 


18, ArabicScheduling# V oiceEnrollment 

a. Description 

Simulates the NCA voice enrollment process. This process asks callers 
for their 10-digit account number. (This is a recognition state.) 

b. Special Features 
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c. 


Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#ArabicScheduling 

ArabicScheduling#ConfirmAccountNbr 

ArabicScheduling#ConfirinAccountNbr 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

elj jJI i-a L) 

0*^1^ (“cl c)jl5 j' 

jdlLJjJI c.1^ jjl Sjl^ jl |adlLjl(_>a^LJ 

. J^l oLjijiJJ 


Details: 

VoiceEnrollment init Volt'S! Jjr' o“ 

j>J lil .jadlLjl^^LJ jaljjl JJjj jl Jl^jl 

jJ' ‘bjbjl_a Sjl^ jl jaljji Sf>bldjjj^LJ i>sl(_5 

d/jro^djJl J^i ttJaJijiJJ jdlj^a LJjjl j^”_ 

Entry Type = reentry 



Details: 

VoiceEnrollment reentry 

” _ 1 LJ 


e. Grammar: 

ArabicScheduling_VoiceEnrollment.gsl#GetAccountNumber 


NL Slots 

Values 

<AccountNumber> 

”[ten-digit-string]”, -S" 

<digit_one> 

jOCjlJdj ,j-^o^ 

<digit_two> 

,“L>“f'C )°5l^j' ^sbjIJdj jijljbjl jJl-ai_>a6^i_>odj ^6(_5(jl|adj ^ 
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<digit_three> 

,°L)^r“C 

<digit_four> 

,°L)^r“C ,J-^o^ 

<digit_five> 

jOejIJej ,J-^o^ 

<digit_six> 

jOejIJej ,J-^o^ 

<digit_seven> 

,°L)^f“C jOejIJej ,J-^o^ 

<digit_eight> 

,°L>“f“C jOejIJej ,J-^o^ 

<digit nine> 

' ,-^c'-S ,“‘^L>“ ,“L)^(“C J joejljdi jjljej 

<digit_ten> 

,°L)^f“C jOejIJej ,J-^o^ 

Sample Phrases 

Slots Filled 


<digit one 

<digit two OL?uV‘^> 

<digit three 

<digit four oa“f>^> 

<digit_five 

<digit_six 

<digit_seven ■i^>j> 

<digit_eight ij'ij‘^'> 

<digit nine j> 

<digit ten u'u‘^'> 

<AccountNumber 

”dtmf-8 dtmf-8 dtmf-8 dtmf-5 dtmf-5 

dtmf-5 dtmf-1 dtmf-2 dtmf-1 dtmf-2” 

<digit_one »L5u'f‘^> 

<digit_two 6LSu't“^> 

<digit three 

<digit four oa“f>^> 

<digit_five 

<digit six OL>“fC> 

<digit_seven ■i^>j> 

<digit_eight 

<digit nine j> 

<digit ten u'u‘^'> 

<AccountNumber “ [ten-digit-string] ”> 
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f. Actions 


Condition 

Action 

Goto 

- 




Details: 

Generic thanks”' 



Assign: AcctNbr a = lastresultS.interpretation.digit one 

Assign: AcctNbr b = lastresult$.interpretation.digit two 

Assign: AcctNbr c = lastresultS.interpretation.digit three 

Assign: AcctNbr d = lastresult$.interpretation.digit four 

Assign: AcctNbr e = lastresultS.interpretation.digit five 

Assign: AcctNbr f= lastresult$.interpretation.digit six 

Assign: AcctNbr g = lastresult$.interpretation.digit seven 

Assign: AcctNbr h = lastresult$.interpretation.digit eight 

Assign: AcctNbr i = lastresult$.interpretation.digit nine 

Assign: AcctNbrJ = lastresult$.interpretation.digit ten 

Assign: accountNbr = lastresult$.interpretation.accountnumber 

ArabicScheduling#Confir 

inAccountNbr 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 


Continue with rec in this 
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nomatch noinput 

Jjl3 j' ^ 

state. 

maxspeechtimeout 




Details: 

VoiceEnrollment error Jj' 

i_a jiliijjLj L^^-s 

°J' J Jl3 j' jJ' 


WHEN(COUNT = 2) 

1#^-“ Of' 

Continue with rec in this 

nomatch noinput 

J jti j' jJ' 

state. 

maxspeechtimeout 




Details: 

VoiceEnrollment error Jj' ijf>“ 

l_a jiLlajLJ L?'-* 

J jl 3 ji e'j jJI 

JI jjl 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

ScsJfJ;. Jj' Of* 

Continue with rec in this 


s^Cj jj^SJ ijji^cS (j! 

el^'jJI SJjj j' J' 

>1^ jJI^ lo jdjjjLj Sjl^ jl 

J Jj' ijf jijiJJ J^j(> ‘-Hjii' »5;.c'A* 

state. 





Details: 

VoiceEnrollment help Jj' uf" 

(/JIJI fLlajjLJ jiUlJ 

jl JI^jI jjl 0 

jj^SJ CJ^L^ Jjlj 

lojdjjjjL-^ j' 
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^ oJa Jj> LJ jJI J^a c.1^ jjllj 


19, ArabicScheduling# V oice V erification 

a. Description 

Simulates the NCA voice verification process. This process asks callers 
for their 10-digit account number. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling# ArabicScheduling 

ArabicScheduling#ConfirmAccountNbr2 

ArabicScheduling#ConfirmAccountNbr2 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 



Details: 

Voice Verification init Jjrl 0 ^“ 

”. 1 LJ 

Entry Type = reentry 



Details: 

Voice Verification reentry Jjij 


e. Grammar: 

ArabicScheduling_ Voice Verification.gsl#GetAccountNumber 


NL Slots 


Values 
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<AccountNumber> 

”[ten-digit-string]”, -S" 

<digit one> 

^eLhijji J ^oeLilJej 

<digit_two> 

e^Uj^CLi J jOejIJdj 

<digit three> 


<digit_four> 

e^Uj^CLi J ,oejlJdj 

<digit five> 

e^Uj^CLi J jOililJej 

<digit six> 

e^Uj^cLi J jOejIJej 

<digit_seven> 

e^Uj^CLi ^eLhijji J ^oejljdj 

<digit_eight> 

e^Uj^CLi ,‘t .^J ,oejlJdj 

<digit nine> 

e^Uj^CLi ^eLhijji J ^oeLilJej 

<digit ten> 

c'j ,“<->“f‘C J joejIJdj 

Sample Phrases 

Slots Filled 


<digit one 


<digit_two £iLsol(>ej> 

jjl jejl-1 

<digit three ol?uV‘^> 

<digit_four »L>“r‘C> 

<digit_five »L>'f>^> 

<digit_six 

<digit_seven ■i^'j> 

<digit_eight u'u‘^'> 

<digit nine-^^lj> 

<digit ten u'u‘^'> 

<AccountNumber J' 

”dtmf-8 dtmf-8 dtmf-8 

<digit_one 

dtmf-5 dtmf-5 dtmf-5 

<digit_two 

dtmf-1 dtmf-2 dtmf-1 

<digit three ol?uV‘^> 

dtmf-2” 

<digit_four »L>“r‘C> 

<digit five »L>“f'C> 

<digit_six 
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<digit_seven 


<digit_eight 


<digit nine j> 


<digit ten u'u‘^'> 


<AccountNumber 831-869-9638> 


f. Actions 


Condition 

Action 

Goto 

- 

1 



Details: 

Generic thanks”' 



Assign: AcctNbr a = lastresultS.interpretation.digit one 

Assign: AcctNbr b = lastresult$.interpretation.digit two 

Assign: AcctNbr c = lastresultS.interpretation.digit three 

Assign: AcctNbr d = lastresult$.interpretation.digit four 

Assign: AcctNbr e = lastresultS.interpretation.digit five 

Assign: AcctNbr f = lastresultS.interpretation.digit six 

Assign: AcctNbr g = lastresult$.interpretation.digit seven 

Assign: AcctNbr h = lastresult$.interpretation.digit eight 

Assign: AcctNbr i = lastresult$.interpretation.digit nine 

Assign: AcctNbrJ = lastresult$.interpretation.digit ten 

Assign: accountNbr = lastresultS.interpretation.accountnumber 

ArabicScheduling#Confir 

mAccountNbr2 
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Error Behaviors 


g’ 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Jjl3 j' 

Jjlj- (_5l_S ji 

jdlLJjJI C.1^ jjl iloijbji-i 

Jj;' ijf> ai=> JO^JJ 

Continue with rec in this 

state. 


Details: 

Voice Verification error j> 

lil SJjtJ 

(>USdj cAs 

jjl Sjl^ iS'-^ 

J^l tJa JijiJJ Jbljja M j3^ J? 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

° Jjl3 j' 

“ ^dj CAl^ a 

Jjlj- jl JI 

jdlJ^a LJjJI J^a c.1^ jjl llojjbjl-a 

J J^' Of' »1=>jijiJJ 

Continue with rec in this 

state. 


Details: 

Voice Verification error j' 

^J bl .jadlLjl^^LJ a^l^JI jaljjl S Jc>“^jl JjJ 

0l_H=I^J' f>'L3jl 0 (>dldj CAlS 
jJI ilajbjij Sjl^ ij'-ji jl 

J^l j^a aJa JijiJJ Jbljja l-Jjji Jja 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

lSiA ('blJ(^^(j.:dj ScsJfJ;. l5‘-* Jj' U(“ 

Jjti j' e'j'jJI ‘Cjji_>aJI 

Continue with rec in this 

state. 
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°jj^Lj cAs (“J 
J(» M Jti' Jf* *'E “Jc J 

. ■\s^z. s-‘Il>“C^ Jj;' Of' jo^JJ 

Details: 

VoiceVerification_help ^‘-VSl c?‘-“ ‘^■^^‘-11 Jjrl (jf>“ 

jl Jl^jl >l^'jjl iCjjjJ^Jl l-a |alIi(jLJ 

|j| j>l(_5jl SJlji^JI JjJj jilildjjj^S-1 (»J 

jcJ Sjl^ j' 

(j(> JiJ^JJ Jf* MjJ' Jf 


20, ArabicDetaineeAppt Page Information 

a. Description 

This page demostrates the eall flow for a detainee appointment scheduling 
application, no interaction with backend database. 

b. Page Variables 


Page Variables Table 

Name 

Initial Value 

Description 

DetaineelSN 



DetainNbr a 



DetainNbrb 



DetainNbr c 



DetainNbrd 



DetainNbr e 



DetainNbr_f 



DetainNbr g 



DetainNbrb 



DetainNbri 
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c. 


Call Flow 



21, Ar abicDetainee Appt#ArabicDetainee Appt 

a. Description 

Ask callers if they would like to schedule a new appointment to visit a 
detainee or check to see if a pending appointment is seheduled. (This is a reeognition 
state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicScheduling#NbrCountV erify 

ArabicDetaineeAppt#CheckAppointment 
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ArabicDetaineeAppt#NewAppointment 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

j(“ elf'll Cx^ -^c' 

O? (jjJjCi lil Ipi Jji_3 jjli-j 

.”»jl(^ jJJ ^ j(*“ : Jjl3 “ j'l5JJJ 


Details: 

ArabicDetaineeAppt initc^^^^'J' -^c' ijf j' 

l3-r‘L>“f‘ :3 jl 5 jJJ L3ML>“f' Of' jjjjjdj 

jIls jJJ 


e. Grammar: 

ArabicDetaineeAppt_ArabicDetaineeAppt.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

newAppoinment, checkAppointment 

Sample Phrases 

Slots Filled 


<userlnput checkAppointment> 

j'cs jJJ -^5; jf” 

<userlnput checkAppointment> 


<userlnput newAppoinment> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

serinput == 

“checkAppointment” 

f'^o' 3® 

Details: 

Generic sure”^Oj-^‘^''^(' f'‘^0' 3®“ 

ArabicDetaineeAppt#Che 

ckAppointment 
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lastresultS. interpretation, u 


ArabicDetaineeAppt#New 

serinput == 


Appointment 

“newAppoinment” 

Details: 



Generie sure”^uj-^‘^'^(> (“^u' J»“ 



g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomateh noinput 

maxspeechtimeout 

^ 0jJJ l3Ml>^ ^ 

.”o j't^jJJ 

Continue with rec in this 

state. 


Details: 

ArabicDetaineeAppt error 

: Jjl 3 “-VSl 

lil Ijoi 

iJ'-Hid'f j(>“ ' jl) jiy-^ » j'(/ jJJ Jr* 

jJJ 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

ujG'^ 

jjjjdj |»dj(jii! lil l^i : 3 jl3 

l5 JJJ eJf' .idlldjJI IjJjji-a o jl 

.”o jl(^ jJJ Jf>“ 

Continue with rec in this 

state. 


Details: 

ArabicDetaineeAppt error 

: Jjti jJ'^ Jf 4“& 

.idiidjjl ^jj.ijdj Ijl 1^1 

Jj>“ 1 jJJji-a 0jl(_5 jJJ JCJ(J0|0 

”.”» jJJ 
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h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

jjJjdj lil • 3jl3 

«• » j'l/ jJJ L3ML>f Jr* Jl 

jJJ ^ 3jl3 

Continue with rec in this 

state. 


Details: 

ArabicDetaineeAppt help 

jf>“ : Jjij jj.2 jCj 

LJ(* Ijl 1^1 

jf‘“ J jl3 «• I j; j j J J (jMO'f' 

jJJ 



22. ArabicDetaineeAppt#CheckAppointment 

a. Description 

(This is a non-recognition processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabieDetaineeAppt# ArabicDetaineeAppt 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 


d. Actions 


0 

Action 

Goto 

- 


CleanUpAndexit sayGoo 


9 .\^ jjl 

dbyeArabic#sayGoodbye 


Details: 



CheckAppointment init U 
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23, ArabicDetaineeAppt#CheckDetaineeISN 

a. Description 

This process simulates interaction with a back-end database. It is 
envisioned that the inputs to the database are the ealler’s aecount number and detainee’s 
ISN. The database will then match the two numbers, if the database eonfirms that the 
ealler is a registered visitor of the detainee, the database will generate a voice recording 
of the detainee’s name. If the two numbers do not mateh, the system will return a prompt 
stating that the caller is not a registered visitor of the detainee. (This is a non-recognition 
processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicDetaineeAppt#ConfinTiDetaineeISN 

ArabicDetaineeAppt#RecordVisitationDate 


d. Actions 


Condition 

Action 

Goto 

- 

“lSjo (“tJJ Jf'CS? 'Jls'j lS j' l5UJ^-^ 

ArabicDetaineeAppt#Rec 


File Expression] [File Expression] [File Expression] [File[ 

Expression] [File Expression] [File Expression] [File Expression] 

[File Expression] [File Expression] [lOOOmsecs] u'J'.' 

1 jSjl“ “LSJO (»l5j 'JLS' j (“oSl ijl 

ordV isitationDate 


Details: 

CheckDetaineelSN initPartl 1 jls' J ls ji ‘ 'ul>oc“ 

File Expression: ’’numbers/” + DetainNbr a + “ high.wav” 

File Expression: ’’numbers/” + DetainNbr b + “ high.wav” 
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File Expression: ’’numbers/” + DetainNbr_c + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_d + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_e + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_f + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_g + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_h + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_i + “_high.wav” 
Silence: 1000 msecs 

CheckDetaineeISN_initPart2 ' jls' J (>^0' uU' 

DetaineeName_Arabic””t^j'ljjjJ' 


24, ArabicDetaineeAppt#ConfirmDetaineeISN 

a. Description 

This process asks callers to confirm the detainee’s 9-digit ISN. (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicDetaineeAppt#EnterDetaineeISN 

ArabicDetaineeAppt#EnterDetaineeISN 

ArabicDetaineeAppt#CheckDetaineeISN 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

File Expression] [File Expression] [File Expression] [File[ J» 

Expression] [File Expression] [File Expression] [File Expression] [File 

Expression] [File Expression] lio jial lil Jo 

Jjl3 o-'j‘ djJ .”'J“ 

Details: 
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GenericPromptConfirm_part 

File Expression: ’’numbers/” + DetainNbr a + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr b + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr c + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr d + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr_e + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr f + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr g + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr b + “_high.wav” 
File Expression: ’’numbers/” + DetainNbr i + “_high.wav” 
GenericPromptConfirm_part2 ^ 

GenericPromptConfirm_yesNo 0“ Jjii 

Jjij ‘ 


e. Grammar: 

ArabicDetaineeAppt_ConfirmDetaineeISN.gsl#Arabic_Rule 


NL Slots 

Values 

<userlnput> 

yes, no 

Sample Phrases 

Slots Filled 

”IJ” 

<userlnput no> 

59 - .99 

<userlnput yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

serinput == “no” 

!i_i(_>ol l(jl 

Details: 

Generic imSorry”!‘-iL>“^ 'ij'“ 

ArabicDetaineeAppt#EnterDetaine 

elSN 

lastresultS.interpretation.u 

serinput == “yes” 


ArabicDetaineeAppt#CheckDetain 

eelSN 
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Error Behaviors 


g- 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

URL[ 

Expression] 

‘ (“4 Jjl3 

.”IJ“ Jjj jjli-j 

Continue with rec in this 

state. 


Details: 

ConfirmDetaineelSN error 

URL Expression: 

genlSNumber(DetaineelSN) 

GenericPromptConfirm yesNo 

f'J Jjl3 *'2 jJ'-* ‘ 

”.”IJ“ Jj(_3 jJI^ ‘ 0^14 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

1 jjliil lil URL[ 

Expression] 

‘ (“4 Jjl3 

.”IJ“ Jjij jjli-j 

Continue with rec in this 

state. 


Details: 

ConfirmDetaineelSN error j^iij u'*^ 

’’ijcS^O^J's-i olSjoJI 

URL Expression: 

genlSNumber(DetaineelSN) 

GenericPromptConfirm yesNo u'*^ 

f'J jJ'*-* ‘ 

”.”IJ“ Jj(_5 c-l^jJI^ ‘ lJ^lS 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

L>= U(* f'ljj ‘C 

URL[ f‘(j jJ' u'*^ '4 

Continue with rec in this 

state. 
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Expression] '^' 

‘ O'^ls (“J ■”?iiCf‘' Jjj 

.”1J“ Jjj C.1^ jJI^-a 

Details: 

ConfirmDetaineeISN_help 

.LX5jL>‘J'‘-r‘ olSjoJI (>l 3J ‘jj’ 

jJI 

URL Expression: 
geni SNumb er(DetaineelSN) 
GenericPromptConfirni_yesNo u'*^ 
j>J lil Jjl 3 jJI'-j ‘ 

”.”IJ“ Jjij jjli-j ‘ 


25. ArabicDetaineeAppt#EnterDetaineeISN 

a. Description 

This process asks callers to enter a detainee’s ISN to schedule a visit. 
(This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicDetaineeAppt#New Appointment 

ArabicDetaineeAppt#ConfirmDetaineeISN 

ArabicDetaineeAppt#ConfirmDetaineeISN 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

f'liJjjUl j' Jjl3 jJ' 

Details: 

EnterDetaineelSN init jl JjJ 
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Entry Type = reentry 

Jl j' Jjti jJI 


Details: 

EnterDetaineelSN reentry 


e. Grammar: 

ArabicDetaineeAppt_EnterDetaineeISN.gsl#GetDetaineeNumber 


NL Slots 

Values 

<DetainNumber> 

”[nine-digit-string]”, 

<digit_one> 

,°L)^r“C J ,J-^o^ 

<digit_two> 

,°L)^r“C ,J-^o^ 

<digit_three> 

,<*^0^ ,“L>“f“C j' >“ 

<digit_four> 

jOejlJili ,J-^o^ 

<digit_five> 

,°L)^r“C J ,J-^o^ 

<digit_six> 

)°51^j' ,stillJdj jijljejl ,j^1j jji-ai_>as^(_>nij ^s(_5(jl^tli 

<digit_seven> 

Sj|^(_>ullj ^S(_5ijl^llj ^S^LJjJs jSllj(_^ ,°L)^r“C J jStlllJlll ,(jl(jtjl ,j-^o^ 

<digit_eight> 

sJ|^(_>u1j ^S(_;ijl^ilj ^S^i-J(_>s ,silj(_^ ,°L)^f“C jStlilJili ,(jl(jiljl ,J-^0^ 

<digit nine> 

SJ|^(_>u1j ^S(_5ijl^llj ^S^LJ(_>s ,silj(_^ ,°L)^f“C J jStlllJlll ,(jl(jtjl ,J-^0^ 

Sample Phrases 

Slots Filled 


<digit_one 

<digit two u'u‘^'> 

<digit three si1jIJi1i> 

<digit_four s^tjjl> 

<digit_five 

<digit six sej(_>i> 

<digit_seven sj-lj(_)s> 

<digit_eight s^j 

<digit nine s^i_>h 1 j> 

<DetainNumber 1 jJ^-olo'^'-stlilJtli-s^tj jl-S(_>ij.^-sej(jj-s^ij(_>i-s^S(jl|Stli- 
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”dtmf-l dtmf-2 dtmf-3 dtmf-4 dtmf- 

5 dtmf-6 dtmf-7 dtmf-8 dtmf-9” 

<digit_one 

<digit two 

<digit three o‘4jlJej> 

<digit_four 

<digit_five 

<digit six 

<digit_seven 

<digit_eight 

<digit nine 

<DetainNumber 


f. Actions 


Condition 

Action 

Goto 


Details: 

Generic thanks” 1 



Assign: DetainNbr a = 

lastresult$.interpretation.digit one 

Assign: DetainNbr b = 

lastresult$. interpretation, digit two 

Assign: DetainNbr c = 

lastresult$. interpretation, digit three 

Assign: DetainNbr d = 

lastresult$.interpretation.digit four 

Assign: DetainNbr e = 

lastresult$.interpretation.digit five 

ArabicDetaineeAppt#Con 

finnDetaineelSN 
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Assign: DetainNbr f = 
lastresult$. interpretation. digit_six 

Assign: DetainNbr_g = 

lastresult$. interpretation. digit_seven 

Assign: DetainNbr h = 
lastresult$. interpretation. digit_eight 

Assign: DetainNbr i = 
lastresult$. interpretation. digit_nine 

Assign: DetaineelSN = 

lastresult$.interpretation.DetainNumber 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 


Continue with rec in this 

nomatch noinput 


state. 

maxspeechtimeout 

Details: 

EnterDetaineelSN error j' JjlS jJ'“ 


WHEN(COUNT = 2) 

-1=^0^ j' Jjti jJ 

Continue with rec in this 

nomatch noinput 


state. 

maxspeechtimeout 

Details: 

EnterDetaineelSN error j' Jjj jl!I“ 



h. State-Specific Universal Behaviors 
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Universal Type 

Action 

Goto 

help 

j' JjJj jd' 

Continue with rec in this 


.0 

state. 


Details; 

EnterDetaineelSN error j' Jjj jdl“ 



26, ArabicDetaineeAppt#New Appointment 

a. Description 

This process asks callers if they have the detainee’s Interment Serial 
Number (ISN). (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicDetaineeAppt#ArabicDetaineeAppt 

ArabicDetaineeAppt#EnterDetaineeISN 


d. 

Pre-rec Prompts 

Type and Condition 

Action 

Entry Type = initial 

J' olsj»J' jjAj jjl AiJ? csJj; djo-^^d' dj;' a? 

lilj :dj(j s-'j jdl'-i ucsjo^d'M o^'^d^ oi^jod' (“aSci lil. 

”'d“ idjti jdl'-i f>aSLi!(j 


Details: 

New Appointment init csdj^ d jo^^d' djrl ijf‘“ jjc^ ujAs O' .A X 

Ui^ja^d'M L>“'^d' »(^jod' (“Jj f>alcjJ j^sj o'al 'i' .u(/jrL>“d'M L>='cd' »i^j=d' fijj 

””'d“ idjcS f-'j; jd''-* f>alcjjj^^j u'^lS (“d ’VSlO^ :djij s'j; jd'^-i 

e. 

Grammar: 


ArabicDetaineeAppt_NewAppointment.gsl#Arabic_Rule 
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NL Slots 

Values 

<userlnput> 

yes, no 

Sample Phrases 

Slots Filled 

”IJ” 

<userlnput no> 

59 - .99 

<userlnput yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

serinput == “no” 

‘j -^C °Jr* ‘jf' 

j>(J jJI lio IJ ojjlij eljlel 

daJljiJJ julLJjjt jJI 

Jj;y 

Return to the calling 

dialog 


Details: 

AccessDenial init = j'l/ jJ jf Jjl 0 ^“ 

(_>al^Jl UJ'^lS o' MJlS ‘e'O^D^J' 

OlSJTijjJIlj IJ jj^'JJ “JlS'^Oj . 

jJ' .Oj‘-*J‘^iJ' f3 jJ' f“dtiLla^l lOO^f'L? 

”.f>L3jJ"i>0 Jj'J daJjjiJJ jUlLJjJI S^jlJ^a 


lastresultS.interpretations 

serinput == “yes” 


ArabicDetaineeAppt#Ente 

rDetaineelSN 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

J' f>L3J |aUlCj (jiul lil 

(“J 'i' j ”(> 5 ^ 0 “ :d jl3 OlS2;l>“J'‘t‘ 

Ocdj ”'c)“ :d jij (.idcijO'di^ 

, 6 i« LSJ^ JjL>=^J' LS'-* 1 jjjJLJ 

Continue with rec in this 

state. 


146 



















Details: 

New Appointment error 

J' f>(jj jj^SJ 

0*^1^ (»J litj ’V£iO“ :Jjl5 

uCOj ”'c]“ : J jij 
,oi» i_sJ^ LS^ 


WHEN(COUNT = 2) 

f>L3J 

Continue with rec in this 

nomatch noinput 

f>J J ’V5i0“ : Jjl3 *' 2^ a^2;L>“J'‘T‘ 

state. 

maxspeechtimeout 

U^UJ ”U“ : J jl3 jJl'-i 0*^1^ 

,6i« lS'-* 



Details: 

New Appointment error 

J' ot/joji f>(jj jj^SJ 

(»J J -4jti jJ'^ 

(j^(jj ”1J“ ; J JJ el^ jjli-i 

,oi» i_sJ^ 'ujJ-^‘-r‘ 

”.‘^V jcl&fc)' 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

jj^LJ (ji ^ Jl>-=“c4' cJj' 0(* 

^l3J olSJ'J' (“l3J 

l>^l5 {“J J :c)jl3 

;_5l_S IjjjjjLJ ij^OJ ”IJ“ : Jjlj jJ''-* 

.dll^_oj6 lSl]^ j JL>^^ JI 

Continue with rec in this 

state. 


Details: 

New Appointment help -^r* csclj: Jjrl 

(»(Jj jj^sj oy^L^ (jl 

:Jjl3 oi^joJI (»jj jj^sj jltsl 

u^uj ”U“ :J jl3 s'j jJl'-i f^cjjj^sj (»J 'jl J ’V&0“ 
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oio lsJj; l 5‘-* 'ijjj-^M”.‘^^f‘jLJ5;(»J', 


27, ArabicDetaineeAppt#RecordVisitationDate 

a. Description 

This state is an Arabic substitution process for the English 

GetDetaineeVisitation Date and Time functions. (This is a record state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicDetaineeAppt#CheckDetaineeISN 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Sjl(_5jjl jj jIlIi Jjj jJI 

Details: 

RecordVisitationDate init of jj l) j3 *' 2 ;jJ' 

ojjjcj ; jGJJ' 

DetaineeName Arabic””LSj'JjjJ' 


e. Actions 


Condition 

Action 

Goto 

- 

o' (“^0* JU ■“ j'l/jd' MiJta 'udjo^ Gd ‘ ' J^L>“ 

CleanUpAndexit sayGoo 


.ejJJ 24 

dbyeArabic#sayGoodbye 


Details: 

RecordVisitationDate_post ‘'1 jal^“ ,»jjl ljJL 

^aCli ljl 24 'uM O' 'jJjO 
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j'(^ jJJ jf* 


f. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Cl/djjj 

jjjjdj sjlcsjJI 

Continue with rec in this 

state. 


Details: 

RecordVisitationDate init -^5;^“ 

»j'l/ jJI Uf jj Cl/djti «-'c jd' 

DetaineeName Arabic 

””i/j'iijjd' 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Cl/djjj «'c 

jjjjcj sU(»jj 

”i/j'djjd' 

Continue with rec in this 

state. 


Details: 

RecordVisitationDate init ■^5:^“ 

»jl(/ jJI Of jj Cl/djti >'c jd' jo^JI 

DetaineeName Arabic 

””i/j'iijJd' 



28, CleanUpAndexit sayGoodbyeArabic Page Information 

a. Description 

b. Page Variables 

There are no variables defined for this page. 
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c. 


Call Flow 



29, CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

a. Description 

(This is a non-recognition processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

ArabicMainMenu# Arabic V i sitinformation 

ArabicMainMenu#ArabicDirections 

ArabicScheduling#RecordReminder 

ArabicDetaineeAppt#CheckAppointment 

ArabicDetaineeAppt#RecordVisitationDate 

CleanUpAndexit_sayGoodbyeArabic#hangup 


d. Actions 


Condition 

Action 

Goto 



CleanUpAndexit sayGoo 

dbyeArabic#hangup 
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Details: 

CleanUpAndExit sayGoodbyeArabic ' 


30, CleanUpAndexit_sayGoodbyeArabic#hangup 

a. Description 

(This is a terminate state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

CleanUpAndexit_sayGoodbyeArabic#sayGoodbye 

- 


H. ARABICMAINMENU APPENDICES 


1, Grammar and Slot Definitions 


Dialog State 

Grammar 

Slots 

Slot Values 

ArabicMainMenu 

#ArabieMain]Vlen 

u 

ArabicMainMenu ArabicM 

ainMenu.gsl#Sample Rule 

userlnput 

infonnation, directions, scheduling, 

ArabicMainMenu 

#Arabic V isitlnfor 

mation 

ArabicMainMenu Arabic Vi 

sitInformation.gsl#Arabic R 

ule 

Userinput 

repeatMessage, retumMainMenu, 

exitSystem, 

ArabicMainMenu 

#ArabicDirections 

ArabicMainMenu ArabicDi 

rections.gsl#Arabic Rule 

Userlnput 

repeatDirections, retumMainMenu, 

exitSystem, 

ArabicScheduling 

#ArabicSchedulin 

g 

ArabicScheduling ArabicSc 

heduling.gsl#Arabic_Rule 

userlnput 

yes, no, 

ArabicScheduling 

#V oiceEnrollment 

ArabicScheduling VoiceEn 

rollment. gsl#Get AccountNu 

mber 

AccountNum 

ber 

digit_one 

” [ten-digit-string] ”, 
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digit_two ,°L>“r'C ,J-‘o^ 

digit_three , 

digit_four 

digit_five ,‘’^'- 7 ^ 0 - ,‘‘^ 0 ^ 

digit_six ,“a“r'C 

digit_seven ,‘’^'- 7 ^ 0 “ ,‘‘^ 0 ^ 

digit_eight ,°L>“r'C ,J-‘o^ 

digit_iiine 

digit_ten ,“L>“r'C 

,“L>'r'C ,u'<j^' ,-^c'j ,>-“<->=■ 

^0^l_yCLi jl^dj 

,‘Ly‘?t ,ul<j^' ,-^c'j ,>-“<->=■ 

^O^l_yCLi jl^dj 

,»L>'r‘C 

^a^l_yCLi jl^dj 

,‘Ly‘?t ,ul<j^' ,-^c'j ,>-“<->=■ 

,»a'r'C ,ul(j^' ,-^c'j 

ArabicScheduling ArabicScheduling_Confirm userinput yes, no, 

#ConfirmAccount AccountNbr. gsl#Arabic_Rul 
Nbr e 


ArabicScheduling 

#NbrCountOne 

ArabicScheduling NbrCoun 

tOne.gsl#Arabic_Rule 

useinput 

nbrCount, 

ArabicScheduling 

#NbrCountTwo 

ArabicSchedulingNbrCoun 

tTwo.gsl#Arabic Rule 

userinput 

nbrCount, 

ArabicScheduling 

#NbrCountThree 

ArabicScheduling NbrCoun 

tThree.gsl#Arabic Rule 

userinput 

nbrCount, 

ArabicScheduling 

#EnrollmentPin 

ArabicScheduling Enrollme 

ntPin.gsl#GetPinNumber 

enrollPin 

digit_one 

digit_two 

digit_three 

digitfour 

”[four-digit-string]”, 

,=L>'r'C 

,=L>'r'C 
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,»a'r'C 

' ,oCjlJcj 

ArabicScheduling 

ArabicScheduling Confirm 

userinput 

yes, no, 

#ConfirmEnrollPi 

n 

EnrollPin.gsl#Arabic Rule 



ArabicScheduling 

ArabicScheduling EnrollCh 

userinput 

enrollMeNow, 

#EnrollCheck 

eck.gsl#Arabic Rule 



ArabicScheduling 

ArabicScheduling Confirm 

userinput 

yes, no, 

#ConfirmAccount 

AccountNbr2.gsl#Arabic R 



Nbr2 

ule 



ArabicScheduling 

ArabicSchedulingNbrCoun 

useinput 

nbrCount, 

#NbrCountV erify 

tVerifiy.gsl#Arabic Rule 



ArabicScheduling 

ArabicScheduling_VoiceVe 

AccountNum 

” [ten-digit-string] ”, 

#V oice V erificatio 

rification.gsl#GetAccountN 

ber 


n 

umber 

digit_one 




digit_two 

,‘Ly‘?t 



digit_three 




digitfour 




digit_five 




digit_six 

,»L>'r'C ,J^o^ 



digit_seven 




digit_eight 

,»L>'r'C ,J^o^ 



digit_nine 




digit_ten 

,»a'r'C 

1 ,»cjljcj ,oIo2jI 

,=L>'r'C 

,»L>'r'C 
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,‘Ly‘?t 













ArabicDetaineeAp 

ArabieDetaineeAppt Arabie 

userinput 

newAppoinment, cheekAppointment, 

pt#ArabicDetaine 

DetaineeAppt.gsl#Arabie R 



eAppt 

ule 



ArabicDetaineeAp 

ArabieDetaineeAppt NewA 

userinput 

yes, no, 

pt#NewAppointm 

ppointment.gsl#Arabie Rul 



ent 

e 



ArabicDetaineeAp 

ArabieDetaineeAppt Enter 

DetainNumbe 

”[nine-digit-string]”, 

pt#EnterDetaineeI 

DetaineeISN.gsl#GetDetain 

r 


SN 

eeNumber 

digit_one 

,‘Ly‘?t 



digit_two 




digit_three 

,‘‘Ly?t 



digitfour 




digit_five 

,“L>'r'C 



digit_six 




digit_seven 

,°L)'r'C ,o'u 



digit_eight 




digit_nine 

,»L>'r'C 

,»L>'r'C 

,»L>'r'C 

,ul<j 

,=L>'r'C ,>-“<->=> 

ArabicDetaineeAp 

ArabieDetaineeAppt Confir 

userinput 

yes, no, 

pt#ConfirmDetain 

mDetaineelSN.gsl# Arabic 



eelSN 

Rule 




154 


















2, Prompt List 


Prompt File 

Transcription 

help universal 


operator universal 

ijj JjMti *' 2 ;j J'” 

global error 1 

”!Ui^l Ij” 

global error2 

f.J lUi^l l(ji” 

global_error3 

cj' 'jcJ<-) 'lju' 'o'” 

”.l3c'^ lS'-* '(j^f 'jj 

ArabicMainMenu init 

jJ^(> jj'lSC J' eJf 

Si-i(jj Jjdj lil lj>l “ Jjj jjli-i ‘6jlc^jJlM 

tijf' LSl!^ lie? i-)jL3 '(j^ 

Jj(j eljj>Uaj 

Genericsure 

(>ejj J»” 

ArabicMainMenu help 

^ lsJ'J' 

i3ls “ :Jjl 3 jJI'-j 

3lSJ^“ :cJjl 3 ‘^yL>“Ue) J(» tiJI 

:JjlJ jJIl-j J'f'J;‘^L>“y »‘-r‘L>“ljJ'‘T‘ 

95 99 V- 

■ 

ArabicMainMenu error 

tiesi-)“” lsJ' 

: Jjti jJ' “^V 

tiJ' JJl>=jJ' ijl/ lJ^ ‘^VI-SJ 

l^al ,”Jj(_HajJl (_ 3 (^jia“ I Jjj jJ'l-S 

: Jj(_3 jjli-i 

ArabicVisitlnfonnation init 

fjLS U(“ jf ljl^j'!>“(*<-)' “ jy J 

»^Il>“<-)' U? f'JS? uULSU'^y' 

^ OJ,a L5 cJ^ (Jo _ joiaji 

I^LJ Ijjjjtdcj ^oj lil V»(^(>0(^tSjJ' (jj-^ ls' lsJ' 

’’.Ja^JI (jy^l ji ”oj>y(_>oJI Jjj el^jjli-a iS i .V'^C 

ArabicVisitinformation errorAndFIelp 

oJj^Jl jjjJjCli (J\ e> J^a eje (jjl Jl ^jjJjCj Jo” 

tjJ^CllClj Cjl^ajJj^^a LSl]^ ^Ol5l>'L^L5jJ' 
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Jf : Jjti JJ'm lsJ' UjG'^ V' -"cSJC ' ° 

lil 1^.1 jJ' : Jj(i *' 2 ^ jJli-i ‘■1‘i^o‘ifis jJ' 

ji JjtJ *' 2 ^ jJI'-i (j^ 

ArabicDirections init 

(^i_a ‘t’ jj;. 20 M ^U(_h=UJ jj» 

JM' JL)^J' l3lS j1=J' lsJ^ Uf' -M 

jm' tiJ' 9 (“l3j 18 S'-slu'f'J 6 

‘ij'JIj .9 (“ijj 2 ;MJj; ^JU^: lsJ^ 

iS lsJI Jjl>“JlJ^ 3lS OJ^J^ cl* 

Is jJ' ‘(■Ls'^ijJ^ lsJI jjli-a lil ?ti(^(_v:(_s 

ArabicDirections errorAndHelp 

s: Jjij jJli-s lsj^' “ jf* Jjl>“ji-1' 3ls t}?o“ 

Jjl3 *' 2 ^ jJI'-i ‘i^O“L^lS jJ^ “flsItiJI ij(3 .”lSJ^' 

Of V' ‘”“i/L)^I^LSJcJ' “f'ci'ljj' “ ^f“ l]j(J jJI‘-“ (»blcljj»J 

”.Ja^JI j'Jj;' ji 

ArabicScheduling init 

IjUjblbj (ji fdaj |ab^Cj(jj:l J^i j^” 

bl V|aUajJI bo (^l_a j(_ 3 UJ(_>.^ j»CjJ^(_)o Jo .|olIi jjl lio liJLJjjOjo Cx^ii^O^f 

Jjl 3 jJI'-j l^JiJI J(^jL>“‘^JI fdaj 1(JLJ(J0|0 |oCjJ^(jo J(j (objjbl 

bl ”f^o“ l^jij' Jl?JL>“^J fll=U ' j‘-r‘L>“f f ^ 0 “ \J fJ 

bo (_ 5 i_a lS‘-“ (“bJjJ|^l(joj(jj 1 jjjjLj j^ jj i”IJ“ Jj(j 0-1^jjli-a 

Generic thanks 

”'ljbSoi” 

ArabicScheduling_help 

IjUjblbj ji (Obll^jjl^ Jl^JL>“‘^ 1-)I fdaj ^ob^djjjol J^i j^” 

dj jil bl .^UajJI bo (^i_a 1 LX^^i^O^f (“d=(j (J‘-^ 'jMiJ'i* -^3 f 

j»djJ^(Jo J(_3 Ijjjdldj |oJ bi 1^1 ”f^o“ Jj(j jJl‘-S 

ucb)j ‘”'J“ cJjti »'2IJ(^Jl>“CjJI joLlaj (^i_a IJljjjo^ 
”.(odajJI bo (^cj Jj^(_>«djJI (^cj ^dlj^l(joj(jo 

ArabicScheduling error 

Jl^ .’V£ld)“ Jjti 1 “ r“^<j'^ ij jjbibj ^J 0 

(^i_a joiiJj^l(joj(jo 1 jjjjLj j^ jj ”IJ“ Jj(J «lj jJ'i-a ^CJCf UL^cljlO” f 

”.(*^ jJ' 

VoiceEnrollment init 

Cjj(_^J1 iji}^ ‘—fl J^CjJI ^UajGJ k/*—^ u” 

® ju^5;.J' Jjci j' cJ'^-^' 

LJ Jl 0 JO^^J jJ' i C?*— i ji 

”• Uf^ jlhJJ J^jf^ m jti' *5;.^'Jf* 
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VoiceEnrollment reentry 


VoieeEnrollment help 

Jj;' (jf” 

03'Aj (ji 

“ Jl ° Jjl3 

t.\^ lojCjjjJLj OcJl^ j' 

Jj;! 0(“ j(J“JJ jf S-" jij' 

VoieeEnrollment error 

eJLjJI J^l (Jij^ ij J^djJI j^liajLJ (J^ 

Generic imSorry 

”!Ui^i l(ji” 

Generic great 


NbrCountOne init 

djlJdj 49 L?J' 1 'j^j' Uf"” 

t_^jljl C^\ j^a , t_5J^ ^ 

^3j teCLilJcli t9 l5cJ^ 1 Uf a-^^^J ej^ JL>^^ 

NbrCounthelp 

J JfJ;, Of'” “jf ‘,J'^ jJI v*^ 

(_sJI lodjljej i jljiljli 19 ljJ' 1 Uf* 

NbrCount error 

iliii-sla ‘9 lsJ' 1 Of' “jf* ,‘^jLH='-r‘ 

(_5JI ioOjIJOj 

NbrCountTwo init 

”?f'‘^JLH»-a Of' cSJc' -jc'^j” 

NbrCountThree init 

”V^atllJ(_pal_a (_5J^i S J^a” 

EnrollmentPin init 

u^fij J 01“ jJ (“'Jj' jU' j^O o'J "oco” 

jj>J >1^jjl tlljij loJIjJjjl (^djJI 6(_3f^djjJl 1_5J^ lo 

”.f“^JLSjL>“^ Of' jO f'tij' jU' ji 0jtj a-'j;jJ' f''^ 

EnrollmentPin reentry 

»'jr jJ'””.LSG J^a j^a jJ |alf3ji j'J' j' J Jl3 

EnrollmentPin errorAndHelp 

”.t“^Ji^jL>“^ Of' jO t'ljj' jU' ji 0 ji3 a-'s!jO'” 

EnrollCheck init 

lio l-a djjl ^aUajUJ (adlj^fjjfj jaj Ifjfjl ‘O^J^” 

0^ CjjjjJaJI LsJ^ ‘-a Of' '0 0,‘^t'C^L>‘ t'd=,OJ' l5 

ji f'fjjjl “iJlS ji= Of 5l‘-“ ^ jL>“i 

i j^J 'O^f JL?j;L>^e)^ Oj'^lS “tics. ji.f'J' “f 
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EnrollCheckerrorAndHelp 
NbrCountV erify_init 


NbrCountVerify_post 


NbrCountV erify_help 


RemindDate init 


RemindDate_po st 


RemindDate error 


RecordSecretDate init 


ReeordSecretDate_post 


ReeordSecretDate error 


VoiceVerification init 


VoiceV erificationreentry 


VoiceV erificationhelp 


VoiceVerification error 


jJI ‘'jj‘-“ 

‘9 lsJ' 1 




UjidjJJ” 1 SJ^Ij SJ|a ‘,J1^ ij? ^ 
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ArabicDetaineeAppt init 

jtilidiJI jjjjjdj eljti jJ'^ 

“j'l^ jeitJ ^Jf 

ArabicDetaineeAppt help 

“j'l/JJe) 3‘-r‘L>f jjjjCj ^ 

Jls JJJ 

ArabicDetaineeAppt error 

'jJjci'— ^ ®j't/ jJJ L3ML>f U(* jtii 

AccessDenial init 

0 “” r'tJJ r"^£lf oj^i^ iJ Mjc? ‘e'uja'J' • Ji^ jJ J(* ^f£l 

<daJ(_>ijj jiilJj> LJJji J(“ jJI jJI f^-^Lsda^l 

NewAppointment help 

o' *-^2^' eJr“” “4?(“i-SJ JjC^ 

f>ijj jj^Lj (jliiS lil .(jojo^Jsj 

uj[;uj ”'J“ : Jj(j jJ'^ Cj^l^ ^ j : Jjii >'2 

NewAppointment error 

oi^^o^JIsj f'lJJ o'*^ : Jjl3 *'2 

u^oj :Jjti f>^ejr'*-^ '^'j 

”.cijl|ajJ^^JI oio 

EnterDetaineelSN init 

”.(^LJ^(»l]' LX#2L>“l-l'‘-r‘ »L>“'ce)' j' JjtJ jJ” 

EnterDetaineelSN reentry 

(“Itij'i-l' -1=5;L>^ j' Jjl3 jJ'” J' 

EnterDetaineelSN error 

”.ljl?2^l)^J's-‘ (“'tij' j' *'s;jJI” 

CheckAppointment init 

jjl 'J ®u'^ 

RecordVisitationDate_post 

Jl LjJia t ' 'uM j' 'j^JU .a j'l^ j 

”.®j'c/jJJ a^'L>“ 24 

CleanUpAndExit sayGoodbyeArabic 


GenericPromptConfimi_part 1 

Jo” 

GenericPromptConfimi_part2 

lie Jo” 
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GenericPromptConfirm yesNo 

”'J“ Jjii f 

ConfirmAccountNbr help 

f“t3j 'i' ijf Jiilldil (jl jl” 

ConfirmAccountNbr error 

”'uL5-^d 'i'” 

ConfirmEnrollmentPin help 

jjial ljl ^(_5j (/uu' o' Uf' 

(“l3j 

ConfirmEnrollmentPin error 

(“l3J o'*^ 'i'” 

NewAppointment init 

ft/Jf J' (“Jj UJ‘^1/ o' MJl/ Jf* LScJ^ cJJuH=^J' J^' Of*” 

LJ (jliil ljl O^'^J' 0(/J0 “c)'m uH='^J' fi/jf J' (»l3J 

””'J“ :Jjl 3 f'j; (“d 'i'j ’V&o^ idjd jJ'^ 

ConfirmDetaineelSN help 

’Vd jd' o'*^ 'i' .oojo^d'sj o^'^d' fi/jfd' f'tij “CO^ Of* t/o^-^” 

ConfirmDetaineelSN error 

”o(/2;o^d'‘-r‘ o^'^d' f(/jfd' (“tij o'*^ 'i'” 

CheckDetaineelSN initPartl 

ft/Jf (“(JJ d(»^i/ OL52:o^d 'djo“(» ”'jls' j f‘‘^o‘^ 'i' lS j' t/ojt,-^ ‘”'6 l>“c” 

’’.o-^'c 

CheckDetaineelSN initPart2 

”.o^'c fojf f'ljj dj'^i/ o(/jo“d 'd2;o^f‘ ' jls'J (“i^o' 'o-^‘^'‘^ oU'jf^o^” 

DetaineeName Arabic 

””(/j'djjd' M^O-f 

RecordVisitationDate init 

®j'^T^ jj' Of"Jj o'^ JjO jj' 


I. ENGMAINMENU OVERVIEW 
1, Application Summary 

a. Variable Definitions 

Application variable information is listed below. 


Application Variables Table 

Name 

Initial Value 

Description 

accountNbr 


another sample variable for the subdialog 

enrollmentPin 
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DATEOUTday 



DATEOUTmonth 



DATE_OUT_year 



TIMEOUTAMPM 



TIMEOUTtime 




2, EngMainMenu Dialog Flow 

a. Universal Behaviors 

Certain capabilities and behaviors are available in all dialog states, unless 
otherwise specified. These are called ‘Universals.’ 

b. Universal Actions 

The ‘Universal Actions’ grammar is active in all states that have 
recognition. This grammar is typically used to allow callers to ask for help, repeat 
prompts, or transfer to an operator. Examples of expressions and corresponding universal 
NL slot fill values are shown in the table below. The following table shows the universals 
available with the Nuance Voice Platform. These aren’t necessarily active in this 
application. 


Universal Values 

Sample Phrases 

cancel 

’eancel’ 


’go back’ 

exit 

’exit’ 


’goodbye’ 

help 

’help’ 

’I need help’ 

mainmenu 

’main menu’ 


’start over’ 

operator 

’Service Representative’ 

’I want to talk with an operator’ 

’agent’ 
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repeat 


’repeat’ 


The following table shows the universal behaviors specified in this application. 


Universal Type 

Action 

Goto 

help 

Okay, here’s some help. 

Details: 

help universal “Okay, here’s some 

help.” 

Continue with recognition in the 

state in which the universal was 

spoken. 

repeat 

AND (_previousBehavior = 

undefined) 


Continue with recognition in the 

state in whieh the universal was 

spoken. 

repeat 

AND (_previousBehavior != 

undefined) 


Throw the event: 

_previousBehavior 

operator 

I’m sorry, there are no representatives 

available. 

Details: 

operator universal “I’m sorry, there 

are no representatives available.” 

Continue with recognition in the 

state in whieh the universal was 

spoken. 

exit 


Return to the calling dialog and 

throw the event: ‘exit’ 

mainmenu 


EngMain]Vtenu#Eng]VtainMenu 


c. Universal Error Handling 

Universal error handling is outlined below. This error behavior can be 
overriden in any given state. 


Error Type 


Action 


Goto 
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WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Sorry. 

Details: 

global errorl “Sorry.” 

Continue with state-specific 

behavior. 

WHEN(COUNT = 2) 

Sorry. I still didn’t get that. 

Continue with state-specific 

nomatch noinput 


behavior. 

maxspeechtimeout 

Details: 

global error2 “Sorry. I still didn’t get 

that.” 


WHEN(COUNT = 3) 

Sorry, we’re experiencing some 

Return to the calling dialog 

nomatch noinput 

technical difficulty right now. Please try 


maxspeechtimeout 

again at a later time. 

Details: 

global_error3 “Sorry, we’re 

experiencing some technical difficulty 

right now. Please try again at a later 

time.” 



J. ENGMAINMENU DIALOG STATES 

This section provides details of the system behavior in each dialog state. 

1, EngMainMenu Page Information 

a. Description 

b. Page Variables 

There are no variables defined for this page. 
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c. 


Call Flow 



2, EngMainMenu#EngMainMenu 

a. Description 

EngMainMenu enables callers to obtain visitation information, get 
directions to BCCF, and use automated scheduling system. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngMainMenu#EngV isitinformation 

EngMainMenu#EngDirections 

EngMainMenu#EngV isitinformation 

EngMainMenu#EngDirections 

Eng S cheduling#Eng S cheduling 


164 













d. 


Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Please select from the following options. To get general visitor 

information, including visiting hours, say ‘information’. To get 

directions to our facility, say ‘directions’. To set up a meeting using our 

automated scheduling system, say ‘scheduling’. 


Details: 

EngMainMenu init “Please select from the following options. To get 

general visitor information, including visiting hours, say ‘information’. 

To get directions to our facility, say ‘directions’. To set up a meeting 

using our automated scheduling system, say ‘scheduling’.” 


e. Grammar: EngMainMenu_EngMainMenu.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

information, directions, scheduling 

Sample Phrases 

Slots Filled 

’’info” 

<userlnput information> 

’’information” 

<userlnput information> 

”uh information” 

<userlnput information> 

’’get information” 

<userlnput information> 

”i’d like to get information” 

<userlnput information> 

’’directions” 

<userlnput directions> 

”uh directions” 

<userlnput directions> 

’’get directions” 

<userlnput directions> 

”i’d like to get directions” 

<userlnput directions> 

’’scheduling” 

<userlnput scheduling> 

”uh scheduling” 

<userlnput scheduling> 
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’’get scheduling” 

<userlnput scheduling> 

”i’d like to use your automated scheduling system” 

<userlnput scheduling> 

’’appointment” 

<userlnput scheduling> 

’’make appointment” 

<userlnput scheduling> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

serinput == “information” 

Sure. 

Details: 

Generic sure “Sure.” 

EngMainMenu#EngV isiti 

nfonnation 

lastresultS.interpretations 

serinput == “directions” 

Sure. 

Details: 

Generic sure “Sure.” 

EngMainMenu#EngDirect 

ions 

lastresultS.interpretations 

serinput == “scheduling” 

Sure. 

Details: 

Generic sure “Sure.” 

EngS cheduIing#Eng S ched 

uling 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Which would you like to do? get 

Continue with rec in this 

nomatch noinput 

information, get directions, or use our 

state. 

maxspeechtimeout 

automated scheduling system. 



Details: 

EngMainMenu error “Which would 

you like to do? get information, get 

directions, or use our automated 

scheduling system.” 
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WHEN(COUNT = 2) 

Which would you like to do? get 

Continue with rec in this 

nomatch noinput 

information, get directions, or use our 

state. 

maxspeechtimeout 

automated scheduling system. 



Details: 

EngMainMenu error “Which would 

you like to do? get information, get 

directions, or use our automated 

scheduling system.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

With this system, you can choose from 

the following options. If you’d like to 

get general visitor information including 

visiting hours, say ‘information’. If 

you’d like to get directions to Baghdad 

Central Correctional Facility, say 

‘directions’. If you’d like to set up a 

visit with a detainee using our 

automated scheduling system, say 

‘scheduling’. 

Details: 

EngMainMenu help “With this system, 

you can choose from the following 

options. If you’d like to get general 

visitor information including visiting 

hours, say ‘information’. If you’d like to 

get directions to Baghdad Central 

Correctional Facility, say ‘directions’. If 

you’d like to set up a visit with a 

detainee using our automated scheduling 

system, say ‘scheduling’.” 

Continue with rec in this 

state. 
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3. 


EngMainMenu#EngDirections 


a. Description 

Get directions to Baghdad Central Correction Facility (BCCF). (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngMainMenu#EngMainMenu 

EngMainMenu#EngMainMenu 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Baghdad Central Correctional Facility is located 20 miles west of 

Baghdad, in the town of Abu Ghraib. From Baghdad, go west on 

highway six for 18 miles then take exit nine at Abu Ghraib. Our facility 

is located 2 miles southwest of exit nine. Would you like to hear the 

directions again or return to the main menu? If you’re done for now, 

please feel free to hang up. 


Details: 

EngDirections init “Baghdad Central Correctional Facility is located 20 

miles west of Baghdad, in the town of Abu Ghraib. From Baghdad, go 

west on highway six for 18 miles then take exit nine at Abu Ghraib. Our 

facility is located 2 miles southwest of exit nine. Would you like to hear 

the directions again or return to the main menu? If you’re done for now, 

please feel free to hang up.” 


e. Grammar: EngMainMenu_EngDirections.gsl#Sample_Rule 


NL Slots 

Values 

<UserInput> 

repeatDirections, retumMainMenu 

Sample Phrases 

Slots Filled 
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’’directions” 

<UserInput repeatDirections> 

”uh directions” 

<UserInput repeatDirections> 

”i’d like to hear the directions again” 

<UserInput repeatDirections> 

”i’d like to listen to the directions again” 

<UserInput repeatDirections> 

”i would like to hear the directions again” 

<UserInput repeatDirections> 

’’info” 

<UserInput repeatDirections> 

’’information” 

<UserInput repeatDirections> 

”uh information” 

<UserInput repeatDirections> 

”i’d like to hear the information again” 

<UserInput repeatDirections> 

”i’d like to listen to the information again” 

<UserInput repeatDirections> 

”i would like to listen to the information again” 

<UserInput repeatDirections> 

”uh main menu” 

<UserInput retumMainMenu> 

’’return to the main menu” 

<UserInput retumMainMenu> 

”i’d like to return to the main menu” 

<UserInput retumMainMenu> 

”i would like to return to the main menu” 

<UserInput retumMainMenu> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.UserInput == 

“repeatDirections” 


Continue with rec in this 

state. 

lastresultS .interpretation. U serinput == 

“returnMainMenu” 


EngMainMenu#EngMain 

Menu 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

Which would you like to do; hear the 

directions again or return to the main 

Continue with rec in this 

state. 
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maxspeechtimeout 

menu? If you’re done for now, please 

feel free to hang up. 



Details: 

EngDirections error 1 “Which would 

you like to do: hear the directions again 

or return to the main menu? If you’re 

done for now, please feel free to hang 

up.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

If you want to hear the directions again, 

say ‘repeat’. If you want to return to the 

main menu, say ‘main menu’. If you’re 

done, say goodbye or just hang up. 

Continue with rec in this 

state. 


Details: 

EngDirections error2 “If you want to 

hear the directions again, say ‘repeat’. If 

you want to return to the main menu, 

say ‘main menu’. If you’re done, say 

goodbye or just hang up.” 



h. State-Specific Universal Behaviors 


Universal Type 

Aetion 

Goto 

repeat 


#EngDirections 

help 

To hear the directions to our facility, say 

‘repeat’. To return to the main menu, 

say ‘main menu’. If you don’t need 

anything else, say goodbye or just hang 

up. 

Continue with rec in this 

state. 


Details: 

EngDirections help “To hear the 

directions to our facility, say ‘repeat’. 

To return to the main menu, say ‘main 
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menu’. If you don’t need anything else, 
say goodbye or just hang up.” 


4, EngMainMenu#EngVisitInformation 

a. Description 

Get visitor information for Baghdad Central Correctional Facility (This is 
a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngMainMenu#EngMainMenu 

EngMainMenu#EngMainMenu 


d. Pre-rec Prompts 


Type and Condition 

Aetion 

Entry Type = initial 

Baghdad Central Correctional Facility is open for detainee visitors from 

8 AM to 4 PM, Monday through Saturday. Would you like to hear that 

information again or return to the main menu? If you’re done for now, 

please feel free to hang up. 


Details: 

EngVisitInformation init “Baghdad Central Correctional Facility is 

open for detainee visitors from 8 AM to 4 PM, Monday through 

Saturday. Would you like to hear that information again or return to the 

main menu? If you’re done for now, please feel free to hang up.” 


e. Grammar: 

EngMainMenu_EngVisitInformation.gsl#Sample_Rule 


NL Slots 

Values 

<UserInput> 

repeatMessage, returnMainMenu 
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Sample Phrases 

Slots Filled 

’’info” 

<UserInput repeatMessage> 

”uh information” 

<UserInput repeatMessage> 

’’hear information” 

<UserInput repeatMessage> 

’’visitor information” 

<UserInput repeatMessage> 

”i’d like to hear the information again” 

<UserInput repeatMessage> 

”i would like to hear the information again” 

<UserInput repeatMessage> 

”i’d like to listen to the information again” 

<UserInput repeatMessage> 

”uh main menu” 

<UserInput retumMainMenu> 

’’return to main menu” 

<UserInput retumMainMenu> 

”go back to main menu” 

<UserInput retumMainMenu> 

”i’d like to return to the main menu” 

<UserInput retumMainMenu> 

”i would like to return to the main menu” 

<UserInput retumMainMenu> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.U 

serinput == 

“repeatMessage” 


Continue with rec in this 

state. 

lastresultS.interpretation.U 

serinput == 

“returnMainMenu” 


EngMainMenu#EngMain 

Menu 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Which do you want to do: hear the 

visitor information again or return to the 

main menu? If you’re done, say 

Continue with rec in this 

state. 
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goodbye or just hang up. 



Details: 

EngVisitInformation error 1 “Which do 

you want to do: hear the visitor 

information again or return to the main 

menu? If you’re done, say goodbye or 

just hang up.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

If you want to hear the visitor 

information again, say ‘repeat’. If you 

want to return to the main menu, say 

‘main menu’. If you’re done, say 

goodbye or just hang up. 

Continue with rec in this 

state. 


Details: 

EngVisitInformation error? “If you 

want to hear the visitor information 

again, say ‘repeat’. If you want to return 

to the main menu, say ‘main menu’. If 

you’re done, say goodbye or just hang 

up.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

repeat 


#EngVisitInformation 

help 

To hear the visitation information again, 

say ‘repeat’. To return to the main 

menu, say ‘main menu’. Or if you don’t 

need anything else, say goodbye or just 

hang up. 

Continue with rec in this 

state. 


Details: 

EngVisitInformation help “To hear the 

visitation information again, say 
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‘repeat’. To return to the main menu, 
say ‘main menu’. Or if you don’t need 
anything else, say goodbye or just hang 
up.” 


5. EngScheduling Page Information 

a. Description 

This page simulates the Nuance Caller Authentication (NCA) Process. 

b. Page Variables 

There are no variables defined for this page. 

c. Call Flow 
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6, EngScheduling#EngScheduling 


a. Description 

Ask callers if they are enrolled in the automated scheduling system. (This 
is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngMainMenu#EngMainMenu 

EngScheduling#VoiceVerification 

EngScheduling#VoiceEnrollment 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

In order to use our automated scheduling system, you must be an 

enrolled user. Are you an enrolled user? If you are, say ‘yes’. If you’re 

not, say ‘no’ and I’ll help you to enroll in our system. 


Details: 

EngScheduling_init “In order to use our automated scheduling system, 

you must be an enrolled user. Are you an enrolled user? If you are, say 

‘yes’. If you’re not, say ‘no’ and I’ll help you to enroll in our system.” 


e. Grammar: EngScheduling_EngScheduling.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

yes, no 

Sample Phrases 

Slots Filled 

”yes” 

<userlnput yes> 

”yup” 

<userlnput yes> 

’’yeah” 

<userlnput yes> 

”i think so” 

<userlnput yes> 
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”no” 

<userlnput no> 

’’maybe” 

<userlnput no> 

”i don’t think so” 

<userlnput no> 

”i don’t know” 

<userlnput no> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretations 

Thanks. 

EngScheduling#V oiceV er 

serinput == “yes” 

Details: 

Generic thanks “Thanks.” 

ification 

lastresultS.interpretations 

Thanks. 

EngScheduling#VoiceEnr 

serinput == “no” 

Details: 

Generic thanks “Thanks.” 

ollment 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

If you’re enrolled, say ‘yes’. If you’re 

not, say ‘no’ and I’ll help you to enroll 

in our system. 

Continue with rec in this 

state. 


Details: 

EngScheduling_errorl “If you’re 

enrolled, say ‘yes’. If you’re not, say 

‘no’ and I’ll help you to enroll in our 

system.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

If you’re already enrolled in our system, 

say ‘yes’. If you’re not or if you’re not 

sure, say ‘no’, and I’ll help you to enroll 

in our system. 

Continue with rec in this 

state. 
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Details: 

EngScheduling_error2 “If you’re 
already enrolled in our system, say 
‘yes’. If you’re not or if you’re not sure, 
say ‘no’, and I’ll help you to enroll in 
our system.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to use our automated scheduling 

Continue with rec in this 


system, you must be an enrolled user. If 

you are already enrolled in our 

automated scheduling system, say ‘yes’. 

If you’re not, say ‘no’ and I’ll help you 

to enroll in our system. 

state. 


Details: 

EngScheduling_help “In order to use 

our automated scheduling system, you 

must be an enrolled user. If you are 

already enrolled in our automated 

scheduling system, say ‘yes’. If you’re 

not, say ‘no’ and I’ll help you to enroll 

in our system.” 



1. EngScheduling#ConfirmAccountNbr 

a. Description 

This process asks callers to confirm their 10-digit aecount number. (This 
is a recognition state.) 

b. Special Features 

c. Entry and Exit States 
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Entry States 

Exit States 

Eng S cheduling# V oiceEnrollment 

EngScheduling#VoiceEnrollment 

EngScheduling#EnrollmentPin 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

I heard [URL Expression] Is that right? 

Details: 

GenericPromptConfirm_partl “1 heard” 

URL Expression: genPhoneNumber(accountNbr) 

GenericPromptConfirm_part2 “Is that right?” 


e. Grammar: 

EngScheduling_ConfirmAccountNbr.gsl#Basic_Yes_No 


NL Slots 

Values 

<confirm> 

yes, no 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.c 

I’m sorry. 

EngScheduling#VoiceEnr 

onfirm = “no” 

Details: 

Generic imSorry “I’m sorry.” 

ollment 

lastresultS.interpretation.c 

Great! 

EngScheduling#Enrollme 

onfirm = “yes” 

Details: 

ntPin 
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Generic great “Great!” 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

I got your account number as [URL 

Expression] If that’s right, say ‘yes’. If 

it’s not, say ‘no’. 

Continue with rec in this 

state. 


Details: 

ConfirmAccountNbr error “I got your 

account number as” 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

I got your account number as [URL 

Expression] If that’s right, say ‘yes’. If 

it’s not, say ‘no’. 

Continue with rec in this 

state. 


Details: 

ConfirmAccountNbr error “I got your 

account number as” 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

I’d like to make sure that I heard your 

account number correctly. That was 

Continue with rec in this 

state. 
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[URL Expression] If that’s right, say 
‘yes’. If it’s not, say ‘no’. 

Details: 

ConfirmAccountNbr help “I’d like to 
make sure that I heard your account 
number eorreetly. That was” 

URL Expression: 
genPhoneNumber(aecountNbr) 
GenericPromptConfirm yesNo “If 
that’s right, say ‘yes’. If it’s not, say 


8, EngScheduling#ConfirmAccountNbr2 

a. Description 

This process asks callers to confirm their 10-digit account number. (This 
is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#VoiceVerifieation 

EngScheduling#VoiceVerification 

EngScheduling#NbrCounfV erify 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

I heard [URL Expression] Is that right? 

Details: 

GenericPromptConfirm_partl “I heard” 

URL Expression: genPhoneNumber(accountNbr) 

GenericPromptConfirm_part2 “Is that right?” 
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e. Grammar: 

EngScheduling_ConfirmAccountNbr2.gsl#Basic_Yes_No 


NL Slots 

Values 

<confirm> 

yes, no 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS .interpretation, c 

I’m sorry. 

EngScheduling#V oiceV er 

onfirm = “no” 

Details: 

Generic imSorry “I’m sorry.” 

ification 

lastresultS .interpretation, c 

Great! 

EngScheduling#NbrCount 

onfirm = “yes” 

Details: 

Generic great “Great!” 

Verify 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

I got your account number as [URL 

Continue with rec in this 

nomatch noinput 

Expression] If that’s right, say ‘yes’. If 

state. 

maxspeechtimeout 

it’s not, say ‘no’. 



Details: 

ConfirmAccountNbr error “I got your 

account number as” 

URL Expression: 

genPhoneNumber(accountNbr) 
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GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 


WHEN(COUNT = 2) 

I got your account number as [URL 

Continue with rec in this 

nomatch noinput 

Expression] If that’s right, say ‘yes’. If 

state. 

maxspeechtimeout 

it’s not, say ‘no’. 

Details: 

ConfirmAccountNbr error “I got your 

account number as” 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

I’d like to make sure that I heard your 

Continue with rec in this 


account number correctly. That was 

[URL Expression] If that’s right, say 

‘yes’. If it’s not, say ‘no’. 

state. 


Details: 

ConfirmAccountNbr help “I’d like to 

make sure that I heard your account 

number correctly. That was” 

URL Expression: 

genPhoneNumber(accountNbr) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 



‘no’.” 
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9, EngScheduling#ConfirmEnrollPin 


a. Description 

This process asks callers to confirm their 4-digit enrollment PfN. (This is 
a reeognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#EnrollmentPin 

EngScheduling#EnrollmentPin 

EngScheduling#EnrollCheck 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

I heard [URL Expression] Is that right? 

Details: 

GenericPromptConfirm_partl “1 heard” 

URL Expression: genEnrollNumber(enrollmentPin) 

GenericPromptConfirm_part2 “Is that right?” 


e. Grammar: 

EngScheduling_ ConfirmEnrollPin.gsl#Basic_ YesNo 


NL Slots 

Values 

<confirm> 

yes, no 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 
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Condition 

Action 

Goto 

lastresultS.interpretation.c 

I’m sorry. 

EngScheduling#Enrollme 

onfirm = “no” 

Details: 

Generic imSorry “I’m sorry.” 

ntPin 

lastresultS.interpretation.c 

Great! 

EngScheduling#EnrollChe 

onfirm = “yes” 

Details: 

Generic great “Great!” 

ck 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

I got your secret date as [URL 

Expression] If that’s right, say ‘yes’. If 

it’s not, say ‘no’. 

Continue with rec in this 

state. 


Details: 

ConfirmEnrollmentPin error “I got 

your secret date as” 

URL Expression: 

genEnrollNumber(enrollmentPin) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

I got your secret date as [URL 

Expression] If that’s right, say ‘yes’. If 

it’s not, say ‘no’. 

Continue with rec in this 

state. 


Details: 

ConfirmEnrollmentPin error “I got 

your secret date as” 

URL Expression: 

genEnrollNumber(enrollmentPin) 

GenericPromptConfirm yesNo “If 
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h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

I’d like to make sure that I heard your 

enrollment code correctly. That code 

was [URL Expression] If that’s right, 

say ‘yes’. If it’s not, say ‘no’. 

Continue with rec in this 

state. 


Details; 



ConfirmEnrolhuentPin help “I’d like to 

make sure that I heard your enrollment 

code correctly. That code was” 

URL Expression: 

genEnrollNumber(erLrollmentPin) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 



10, EngScheduling#ConfirmSecretDate 

a. Description 

This process asks callers to confirm their secret date. (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#GetSecretDate 

EngScheduling#GetSecretDate 

EngScheduling#RecordReminder 
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d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

I heard [lOOmsecs] [date:m] [50msecs] [date:d] [SOmsecs] [date:y] 

[lOOmsecs] Is that right? 

Details: 

GenericPromptConfirm_partl “1 heard” 

Silence: 100 msecs 

TTS Expression [date:m]: DATE OUT month 

Silence: 50 msecs 

TTS Expression [date:d]: DATE OUT day 

Silence: 50 msecs 

TTS Expression [date:y]: DATE OUT year 

Silence: 100 msecs 

GenericPromptConfirm_part2 “Is that right?” 


e. Grammar: 

EngScheduling_ ConfirmSecretDate.gsl#Basic_ YesNo 


NL Slots 

Values 

<confirm> 

no, yes 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS .interpretation, c 

onfirm = “no” 

I’m sorry. 

Details: 

Generic imSorry “Em sorry.” 

EngScheduling#GetSecret 

Date 

lastresultS. interpretation, c 

Sure. 

EngScheduling#RecordRe 
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onfirm = “yes” 

Details: 

minder 


Generic sure “Sure.” 



g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

I’d like to make sure I got your secret 

date correctly. I heard the date as 

[lOOmsecs] [date:m] [SOmsecs] [daterd] 

[SOmsecs] [date:y] [lOOmsecs] If that’s 

right, say ‘yes’. If it’s not, say ‘no’. 

Details: 

ConfirmSecretDate error “I’d like to 

make sure I got your secret date 

correctly. I heard the date as” 

Silence: 100 msecs 

TTS Expression [date:m]: 

DATE OUT month 

Silence: 50 msecs 

TTS Expression [date:d]: 

DATEOUTday 

Silence: 50 msecs 

TTS Expression [date:y]: 

DATEOUTyear 

Silence: 100 msecs 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 

Continue with rec in this 

state. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

I’d like to make sure I got your secret 

date correctly. I heard the date as 

[lOOmsecs] [date:m] [50msecs] [date:d] 

[50msecs] [date:y] [lOOmsecs] If that’s 

right, say ‘yes’. If it’s not, say ‘no’. 

Continue with rec in this 

state. 
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Details: 

ConfirmSecretDate error “I’d like to 
make sure I got your seeret date 
eorrectly. I heard the date as” 

Silence: 100 msecs 

ITS Expression [date:m]: 

DATEOUTmonth 

Silence: 50 msecs 

ITS Expression [date:d]: 

DATEOUTday 

Silence: 50 msecs 

ITS Expression [date:y]: 

DATEOUTyear 

Silence: 100 msecs 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

I’d like to make sure I got your secret 

Continue with rec in this 


date correctly. If your secret date is 

[lOOmsecs] [date:m] [50msecs] [date:d] 

[50msecs] [date:y] [lOOmsecs] If that’s 

right, say ‘yes’. If it’s not, say ‘no’. 

state. 


Details: 

ConfirmSecretDate help “I’d like to 

make sure I got your secret date 

correctly. If your secret date is” 

Silence: 100 msecs 

ITS Expression [date:m]: 

DATE OUT month 
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Silence: 50 msecs 

ITS Expression [date:d]: 

DATEOUTday 

Silence: 50 msecs 

ITS Expression [date:y]: 

DATEOUTyear 

Silence: 100 msecs 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 


11, EngScheduling#EnrollCheck 

a. Description 

This process asks callers if they would like to “enroll me now.” For 
demostration purposes, links to additional verifioation information is not ineluded in this 
applieation. (This is a reeognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#ConfirmEnroIlPin 

Eng S cheduIing#NbrCountOne 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Now it looks like we haven’t yet enrolled you in our Voiceprint 

Verification System. This’ll let us identify you using your unique 

voiceprint, which is faster and more convenient that a PIN or password. 

We only need to enroll you once, and it’ll just take a minute. To go 

ahead with the enrollment process right now, say ‘enroll me now’. 


Details: 


EnrollCheck init “Now it looks like we haven’t yet enrolled you in our 


190 











Voiceprint Verification System. This’ll let us identify you using your 
unique voiceprint, which is faster and more convenient that a PIN or 
password. We only need to enroll you once, and it’ll just take a minute. 
To go ahead with the enrollment process right now, say ‘enroll me 
now’.” 


e. Grammar: EngScheduling_EnrollCheck.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

enrollMeNow 

Sample Phrases 

Slots Filled 

’’enroll” 

<userlnput enrollMeNow> 

’’enroll me” 

<userlnput enrollMeNow> 

’’enroll me now” 

<userlnput enrollMeNow> 

”uh enroll me now” 

<userlnput enrollMeNow> 

”i want to enroll now” 

<userlnput enrollMeNow> 

’’sure enroll me now” 

<userlnput enrollMeNow> 

’’please enroll me now” 

<userlnput enrollMeNow> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

serinput == 

“enrollMeNow” 

Thanks. 

Details: 

Generic thanks “Thanks.” 


— 


EngScheduling#NbrCount 

One 
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Error Behaviors 


g’ 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

To get started on the enrollment process, 

say ‘enroll me now’. 

Details: 

EnrollCheck error “To get started on 

the enrollment process, say ‘enroll me 

now’.” 

Continue with rec in this 

state. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

To get started on the enrollment process, 

say ‘enroll me now’. 

Details: 

EnrollCheck error “To get started on 

the enrollment process, say ‘enroll me 

now’.” 

Continue with rec in this 

state. 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

To go ahead with the enrollment process 

Continue with rec in this 


right now, say ‘enroll me now’. 

state. 


Details: 

EnrollCheck help “To go ahead with 

the enrollment process right now, say 

‘enroll me now’.” 



12, EngScheduling#EnrollnientPin 

a. Description 

This process asks caller for their 4-digit enrollment PIN. (This is a 
reeognition state.) 

b. Special Features 
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c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#ConfirniAccountNbr 

EngScheduling#ConfirniEnrollPin 

EngScheduling#ConfirmEnrollPin 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Next, I need to get the 4-digit enrollment code from the enrollment 

notice that we sent you. So take a moment to find that code now, and 

when you’re ready, go ahead and say it, or just key it in. 


Details: 

EnrollmentPin init “Next, I need to get the 4-digit enrollment code 

from the enrollment notiee that we sent you. So take a moment to find 

that code now, and when you’re ready, go ahead and say it, or just key it 

in.” 

Entry Type = reentry 

Please say or key in your 4-digit enrollment code again. 


Details: 

EnrollmentPin reentry “Please say or key in your 4-digit enrollment 

code again.” 


e. Grammar: builtin:digits?length=4;minlength=4;maxlength=4 


NL Slots 

Values 

<enrollmentPin> 

pinNbr 

Sample Phrases 

Slots Filled 

’’one two three four” 

<built-in true> 


f. Actions 


Condition 


Action 


Goto 
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lastresult == true 

Thanks. 



Details: 



Generic_thanks “Thanks.” 


— 

Assign: enrollmentPin = lastresult 

EngScheduling#ConfirmE 

nrollPin 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Please say or key in your 4-digit 

Continue with rec in this 

nomateh noinput 

enrollment code. 

state. 

maxspeechtimeout 

Details: 

EnrollmentPin error “Please say or key 

in your 4-digit enrollment code.” 


WHEN(COUNT = 2) 

Please say or key in your 4-digit 

Continue with rec in this 

nomatch noinput 

enrollment code. 

state. 

maxspeechtimeout 

Details: 

EnrollmentPin error “Please say or key 

in your 4-digit enrollment code.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

Please say or key in your 4-digit 

Continue with rec in this 


enrollment code from the enrollment 

state. 


notice that we sent you. 



Details: 

EnrollmentPin help “Please say or key 

in your 4-digit enrollment code from the 

enrollment notice that we sent you.” 
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13, EngScheduling#GetSecretDate 


a. Description 

This process asks callers for a secret date, callers can specify the day, 
month and the year. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#NbrCountThree 

EngScheduling#ConfirmSecretDate 

EngScheduling#ConfirmSecretDate 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Next I’ll get the secret information that we’ll ask you for occasionally. 

This’ll be a date that’s easy for you to remember, but hard for others to 

guess, like a special anniversary or a friend’s birthday. So, think of the 

secret date you’d like to use, and when you’re ready, just tell me that 

date, including the year, like this April 1st 1998. 


Details: 

GetSecretDate init “Next I’ll get the secret information that we’ll ask 

you for occasionally. This’ll be a date that’s easy for you to remember, 

but hard for others to guess, like a special anniversary or a friend’s 

birthday. So, think of the secret date you’d like to use, and when you’re 

ready, just tell me that date, including the year, like this April 1st 1998.” 

Entry Type = reentry 

Please reenter your secret date, like this, April 1st 1998. 


Details: 

GetSecretDate reentry “Please reenter your secret date, like this, April 

1st 1998.” 
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e. Grammar: 

EngScheduling_GetSecretDate.gsl#DA TE_ VOICEORDTME 


NL Slots 

Values 

<day> 

day 

<month> 

month 

<year> 

year 

Sample Phrases 

Slots Filled 

’’may thirteenth nineteen ninety-nine” 

<day day> 

<month month> 

<year year> 

’’the thirteenth of may nineteen ninety nine” 

<day day> 

<month month> 

<year year> 

’’five thirteen nineteen ninety nine” 

<day day> 

<month month> 

<year year> 


f. Actions 


Condition 

Action 

Goto 


Thanks. 

Details: 

Generic thanks “Thanks.” 

Assign: DATE OUT day = 

lastresultS. interpretation, date, day 

Assign: DATE OUT month = 

lastresultS. interpretation, date, month 

Assign: DATE OUT year = 
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lastresult$. interpretation, date, year 

Log: ’DATE OUT day is ‘ + DATE OUT day 

Log: ’DATE OUT month is ‘ + 

DATEOUTmonth 

Log: ’DATE OUT year is ‘ +DATE_OUT_year 


— 


EngScheduling#ConfirmS 

ecretDate 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN ( COLTNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Please say or key in your secret date, 

like this, April 1st 1998. 

Details: 

GetSecretDate error 1 “Please say or 

key in your secret date, like this, April 

1st 1998.” 

Continue with rec in this 

state. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Please enter a date that’s easy for you to 

remember, but hard for others to guess, 

like a special anniversary or a friend’s 

birthday. So, think of the secret date 

you’d like to use, and when you’re 

ready, just tell me that date, including 

the year, like this April 1st 1998. 

Continue with rec in this 

state. 


Details: 

GetSecretDate error2 “Please enter a 

date that’s easy for you to remember, 

but hard for others to guess, like a 

special anniversary or a friend’s 

birthday. So, think of the secret date 
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you’d like to use, and when you’re 
ready, just tell me that date, including 
the year, like this April 1st 1998.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

Please enter a secret date that’s easy for 

you to remember, but hard for others to 

guess. When you’re ready, just tell me 

that date, including the year, like this 

April 1st 1998. 

Continue with rec in this 

state. 


Details: 

GetSecretDate help “Please enter a 

secret date that’s easy for you to 

remember, but hard for others to guess. 

When you’re ready, just tell me that 

date, including the year, like this April 

1st 1998.” 



14, EngScheduling#NbrCountOne 

a. Description 

Number count one for voice model collection. This process asks callers to 
count from 1 to 9. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#EnrollCheck 

EngScheduling#NbrCountTwo 


d. Pre-rec Prompts 
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Type and Condition 

Action 

Entry Type = initial 

Now, to create your voiceprint, first I’ll ask you to count from 1 to 9, 

three separate times, so that the system can analyze your voice. Then I’ll 

ask you for some secret information that we might need to get from you 

occasionally, just for extra security. So to get started, please count out 

loud, once from 1 to 9 like this, one, two, three, and so on. 


Details: 

NbrCountOne init “Now, to create your voiceprint, first I’ll ask you to 

count from 1 to 9, three separate times, so that the system can analyze 

your voice. Then I’ll ask you for some secret information that we might 

need to get from you occasionally, just for extra security. So to get 

started, please count out loud, once from 1 to 9 like this, one, two, three, 

and so on.” 


e. Grammar: EngScheduling_NbrCountOne.gsl#Sample_Rule 


NL Slots 

Values 

<uselnput> 

nbrCount 

Sample Phrases 

Slots Filled 

’’one two three four five six seven eight nine” 

<uselnput nbrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

seinput = “nbrCounf ’ 


EngScheduling#NbrCount 

Two 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Please count out loud, once, from 1 to 9 

like this one, two, three, and so on. 

Continue with rec in this 

state. 
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Details: 

NbrCount error “Please count out loud, 

once, from 1 to 9 like this one, two, 

three, and so on.” 


WHEN(COUNT = 2) 

Please count out loud, once, from 1 to 9 

Continue with rec in this 

nomatch noinput 

like this one, two, three, and so on. 

state. 

maxspeechtimeout 

Details: 

NbrCount error “Please count out loud, 

once, from 1 to 9 like this one, two, 

three, and so on.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to create your voiceprint, please 

Continue with rec in this 


count out loud, once from 1 to 9 like 

state. 


this, one, two, three, and so on. 



Details: 

NbrCount help “In order to create your 

voiceprint, please count out loud, once 

from 1 to 9 like this, one, two, three, and 

so on.” 



15, EngScheduling#NbrCountThree 

a. Description 

Number count three for voice model collection. (This is a recognition 

state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 


Exit States 
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Eng S cheduling#NbrCountT wo 


EngScheduling#GetSecretDate 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

And one last time. 


Details: 


NbrCountThree init “And one last time.” 


e. Grammar: EngScheduling_NbrCountThree.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

nhrCount 

Sample Phrases 

Slots Filled 

’’one two three four five six seven eight nine” 

<userlnput nhrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

serinput == “nhrCount” 

Great! 

Details: 

Generic great “Great!” 

EngScheduling#GetSecret 

Date 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Please count out loud, once, from 1 to 9 

Continue with rec in this 

nomatch noinput 

like this one, two, three, and so on. 

state. 

maxspeechtimeout 

Details: 



NbrCount error “Please count out loud, 



once, from 1 to 9 like this one, two. 
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three, and so on.” 


WHEN(COUNT = 2) 

Please count out loud, once, from 1 to 9 

Continue with ree in this 

nomatch noinput 

like this one, two, three, and so on. 

state. 

maxspeechtimeout 

Details: 

NbrCount error “Please count out loud, 

once, from 1 to 9 like this one, two, 

three, and so on.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to create your voiceprint, please 

Continue with rec in this 


count out loud, once from 1 to 9 like 

state. 


this, one, two, three, and so on. 



Details: 

NbrCount help “In order to create your 

voiceprint, please eount out loud, once 

from 1 to 9 like this, one, two, three, and 

so on.” 



16, EngScheduling#NbrCountTwo 

a. Description 

Number count two for voice model collection. (This is a recognition 

state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#NbrCountOne 

EngScheduling#NbrCount Three 


d. 


Pre-rec Prompts 
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Type and Condition 

Action 

Entry Type = initial 

And, once more, please? 


Details: 


NbrCountTwo init “And, once more, please?” 


e. Grammar: EngScheduling_NbrCountTwo.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

nbrCount 

Sample Phrases 

Slots Filled 

’’one two three four five six seven eight nine” 

<userlnput nbrCount> 


f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

serinput == “nbrCount” 


EngScheduling#NbrCount 

Three 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Please count out loud, once, from 1 to 9 

Continue with rec in this 

nomatch noinput 

like this one, two, three, and so on. 

state. 

maxspeechtimeout 

Details: 

NbrCount error “Please count out loud, 

once, from 1 to 9 like this one, two, 

three, and so on.” 


WHEN(COUNT = 2) 

Please count out loud, once, from 1 to 9 

Continue with rec in this 

nomatch noinput 

like this one, two, three, and so on. 

state. 

maxspeechtimeout 

Details: 



NbrCount error “Please count out loud. 
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once, from 1 to 9 like this one, two, 
three, and so on.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to create your voiceprint, please 

Continue with rec in this 


count out loud, once from 1 to 9 like 

state. 


this, one, two, three, and so on. 



Details: 

NbrCount help “In order to create your 

voiceprint, please count out loud, once 

from 1 to 9 like this, one, two, three, and 

so on.” 



17, EngScheduling#NbrCount Verify 

a. Description 

Number count for voice verification. This process asks callers to count 
from 1 to 9. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#ConfirmAccountNbr2 

EngDetaineeAppt#EngDetaineeAppt 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Now to verify your voice, please count out loud from one up to nine. 


Details: 


NbrCount Verify _init “Now to verify your voice, please count out loud 
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from one up to nine.” 


e. Grammar: EngScheduling_NbrCountVerifiy.gsl#Sample_Rule 


NL Slots 

Values 

<uselnput> 

nbrCount 

Sample Phrases 

Slots Filled 

’’one two three four five six seven eight nine” 

<uselnput nbrCount> 


f. Actions 


Condition 

Aetion 

Goto 

lastresultS.interpretation.u 

seinput = “nbrCounf ’ 

You’re been verified. 

Details: 

NbrCountVerify_post “You’re been verified.” 

EngDetaineeAppt#EngDet 

aineeAppt 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Please count out loud, once, from 1 to 9 

like this one, two, three, and so on. 

Details: 

NbrCount error “Please count out loud, 

once, from 1 to 9 like this one, two, 

three, and so on.” 

Continue with rec in this 

state. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Please count out loud, once, from 1 to 9 

like this one, two, three, and so on. 

Details: 

NbrCount error “Please count out loud, 

once, from 1 to 9 like this one, two, 

three, and so on.” 

Continue with rec in this 

state. 
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h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to verify your account, please 

Continue with rec in this 


count out loud once from 1 to 9 like this, 

one, two, three and so on. 

state. 


Details: 

NbrCountVerify help “In order to 

verify your account, please count out 

loud once from 1 to 9 like this, one, two, 

three and so on.” 



18, EngScheduling#RecordRe minder 

a. Description 

This process simulates the NCA proeess of recording a callers’ hint to 
their seeret date. For demostration purposes, this reeording is not saved to any backend 
database. (This is a record state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#ConfirmSecretDate 

- 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Now think of a hint that’ll remind you of that date. After you hear the 

beep, tell me that hint and we’ll record it so that we can play it back to 

you later. So, for example, you might say my mother’s birthday or my 

graduation date. 
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Details: 

RemindDate init “Now think of a hint that’ll remind you of that date. 
After you hear the beep, tell me that hint and we’ll record it so that we 
can play it back to you later. So, for example, you might say my 
mother’s birthday or my graduation date.” 


e. Actions 


Condition 

Action 

Goto 


OK! we’ve successfully enrolled your voiceprint. 

Details: 

RemindDate_post “OK! we’ve successfully 

enrolled your voiceprint.” 

Return to the calling 

dialog 


f. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Please tell me a hint that will remind 

you of your secret date. 

Details: 

RemindDate error “Please tell me a 

hint that will remind you of your secret 

date.” 

Continue with rec in this 

state. 

WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Please tell me a hint that will remind 

you of your secret date. 

Details: 

RemindDate error “Please tell me a 

hint that will remind you of your secret 

date.” 

Continue with rec in this 

state. 
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19, EngScheduling#V oiceEnrollment 


a. Description 

Simulates the NCA voiee enrollment process. This process asks callers 
for their 10-digit account number. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#EngScheduling 

EngScheduling#ConfirmAccountNbr 

EngScheduling#ConfirmAccountNbr 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

To get started on the voice enrollment process, I need your 10-digit 

account number. If you don’t have an account number, or if you’ve lost 

it, please go to your nearest police station to register for a new account. 

If you have the account number, go ahead and say or key it in now. 


Details: 

VoiceEnrollment init “To get started on the voice enrollment process, I 

need your 10-digit account number. If you don’t have an account 

number, or if you’ve lost it, please go to your nearest police station to 

register for a new account. If you have the account number, go ahead 

and say or key it in now.” 

Entry Type = reentry 

Please say or key-in your 10-digit account number one more time. 


Details: 

VoiceEnrollment reentry “Please say or key-in your 10-digit account 

number one more time.” 
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e. Grammar: 

builtin: digits? length=l 0;minlength=l 0;maxlength=l 0 


NL Slots 

Values 

<userlnput> 

accountNbr 

Sample Phrases 

Slots Filled 

’’zero one two three four five six seven eight nine” 

<built-in “yes”> 


f. Actions 


Condition 

Action 

Goto 

lastresult == true 

Thanks. 



Details: 

Generic_thanks “Thanks.” 


— 

Assign: accountNbr = lastresult 

EngScheduling#ConfirmA 

ccountNbr 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Please say or key-in your 10-digit 

Continue with rec in this 

nomatch noinput 

account number. 

state. 

maxspeechtimeout 

Details: 

VoiceEnrollment error 1 “Please say or 

key-in your 10-digit account number.” 


WHEN(COUNT = 2) 

To get you started on the voice 

Continue with rec in this 

nomatch noinput 

enrollment process, I need to have your 

state. 

maxspeechtimeout 

10-digit account number. Please key it 

in, or say ‘help’ for more information. 



Details: 
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VoiceEnrollment_error2 “To get you 
started on the voice enrollment process, 
I need to have your 10-digit account 
number. Please key it in, or say ‘help’ 
for more information.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to enroll in our automated 

Continue with rec in this 


scheduling system, you must have a 10- 

digit account number. If you don’t have 

your account number or if you’ve lost it, 

please hang up and go to your local 

police station to register for a new 

account. If you have your account 

number, please say or key-in the number 

state. 


now. 



Details: 

VoiceEnrollment help “In order to 

enroll in our automated scheduling 

system, you must have a 10-digit 

account number. If you don’t have your 

account number or if you’ve lost it, 

please hang up and go to your local 

police station to register for a new 

account. If you have your account 

number, please say or key-in the number 

now.” 



20, EngScheduling#V oice Verification 
a. Description 
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Simulates the NCA verification process. This process asks callers for their 
10-digit account number. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngScheduling#EngScheduling 

EngScheduling#ConfirmAccountNbr2 

EngScheduling#ConfirmAccountNbr2 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

To get started, go ahead and say or key-in your 10-digit account number. 


Details: 

Voice Verification init “To get started, go ahead and say or key-in your 

10-digit account number.” 

Entry Type = reentry 

Please say or key-in your 10-digit account number one more time. 


Details: 

Voice Verification reentry “Please say or key-in your 10-digit account 

number one more time.” 


e. Grammar: 

builtin: digits? length=l 0;minlength=l 0;maxlength=l 0 


NL Slots 

Values 

<userlnput> 

accountNbr 

Sample Phrases 

Slots Filled 

’’zero one two three four five six seven eight nine” 

<built-in true> 


f. Actions 
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Condition 

Action 

Goto 

lastresult == true 

Thanks. 



Details: 

Generic thanks “Thanks.” 


— 

Assign: accountNbr = lastresult 

EngScheduling#ConfirmA 

ccountNbr2 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Please say or key-in your 10-digit 

Continue with rec in this 

nomatch noinput 

account number. 

state. 

maxspeechtimeout 

Details: 

Voice Verification error 1 “Please say or 

key-in your 10-digit account number.” 


WHEN(COUNT = 2) 

Please key-in your 10-digit account 

Continue with rec in this 

nomatch noinput 

number or say ‘help’ for more 

state. 

maxspeechtimeout 

information. 



Details: 

Voice Verification error2 “Please key- 

in your 10-digit account number or say 

‘help’ for more information.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

To get started on the voice verification 

process, please say or key-in your 10- 

digit account number. If you don’t have 

a 10-digit account number or if you’ve 

lost it, please go to your local police 

Continue with rec in this 

state. 
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station to register for a new account. If 
you have the number, please go ahead 
and say or key it in now. 

Details: 

VoiceVerifieation help “To get started 
on the voice verification process, please 
say or key-in your 10-digit account 
number. If you don’t have a 10-digit 
aecount number or if you’ve lost it, 
please go to your loeal poliee station to 
register for a new aecount. If you have 
the number, please go ahead and say or 
key it in now.” 


21, EngDetaineeAppt Page Information 

a. Description 

This page demostrates the call flow for a detainee appointment scheduling 
application, no interaction with backend database. 

b. Page Variables 


Page Variables Table 

Name 

Initial Value 

Deseription 

DetaineelSN 
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c. 


Call Flow 



22. EngDetaineeAppt#EngDetaineeAppt 

a. Description 

Ask callers if they would like to schedule a new appointment to visit a 
detainee or check to see if a pending appointment is seheduled. (This is a reeognition 
state.) 

b. Special Features 

c. Entry and Exit States 
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Entry States 

Exit States 

EngScheduling#NbrCountVerify 

EngDetaineeAppt#CheckAppointment 

EngDetaineeAppt#New Appointment 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Next, please select from the following options. If you’d like to make a 

new appointment, say ‘new appointment’. If you’d like to check the 

status of a pending appointment, say ‘check appointment’. 


Details: 

EngDetaineeAppt init “Next, please select from the following options. 

If you’d like to make a new appointment, say ‘new appointment’. If 

you’d like to check the status of a pending appointment, say ‘check 

appointment’.” 


e. Grammar: 

EngDetaineeAppt_EngDetaineeAppt.gsl#Sample_Rule 


NL Slots 

Values 

<userlnput> 

newAppoinment, checkAppointment 

Sample Phrases 

Slots Filled 

’’check appointment” 

<userlnput checkAppointment> 

”uh check appointmenf ’ 

<userlnput checkAppointment> 

”i’d like to check appointment” 

<userlnput checkAppointment> 

’’check existing appointmenf’ 


’’new appointmenf’ 

<userlnput newAppoinment> 

”uh new appointment” 

<userlnput newAppoinment> 

’’make new appointment” 

<userlnput newAppoinment> 

”i’d like to make a new appointment” 

<userlnput newAppoinment> 
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f. Actions 


Condition 

Action 

Goto 

lastresultS.interpretation.u 

Sure. 

EngDetaineeAppt#Clieck 

serinput == 


Appointment 

“checkAppointment” 

Details: 

Generic sure “Sure.” 


lastresultS.interpretation.u 

Sure. 

EngDetaineeAppt#NewA 

serinput == 


ppointment 

“newAppoinment” 

Details: 

Generic sure “Sure.” 



g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Which did you want to do: set up a new 

appointment or check a pending 

appointment? 

Continue with rec in this 

state. 


Details: 

EngDetaineeAppt errorl “Which did 

you want to do: set up a new 

appointment or check a pending 

appointment?” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

To set up a new appointment now, say 

‘new appointment’. To check a pending 

appointment, say ‘check appointment’. 

Continue with rec in this 

state. 


Details: 

EngDetaineeAppt error? “To set up a 

new appointment now, say ‘new 

appointment’. To check a pending 

appointment, say ‘check appointment’.” 
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h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

If you’d like to make a new appointment 

Continue with ree in this 


to meet with a detainee, say ‘new 

appointment’. If you’d like to check a 

pending appointment to see if it has 

been scheduled, say ‘check 

appointment’. 

state. 


Details: 

EngDetaineeAppt help “If you’d like to 

make a new appointment to meet with a 

detainee, say ‘new appointment’. If 

you’d like to eheck a pending 

appointment to see if it has been 

scheduled, say ‘check appointment’.” 



23, EngDetaineeAppt#CheckAppointment 

a. Description 

(This is a non-recognition processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngDetaineeAppt#EngDetaineeAppt 

- 


d. Actions 


Condition 

Aetion 

Goto 

— 

Based on our records, you have no scheduled 

appointments at this tiiue. If you’ve called earlier 

Return to the calling 

dialog 
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to set up an appointment, note that it takes 24 hours 
for the appointment to get scheduled. Please check 
back at a later time. 

Details: 

CheckAppointment init “Based on our records, 
you have no scheduled appointments at this time. If 
you’ve called earlier to set up an appointment, note 
that it takes 24 hours for the appointment to get 
scheduled. Please check back at a later time.” 


24, EngDetaineeAppt#CheckDetaineeISN 

a. Description 

This process simulates interaction with a back-end database. It is 
envisioned that the inputs to the database are the caller’s account number and detainee’s 
ISN. The database will then match the two numbers, if the database confirms that the 
caller is a registered visitor of the detainee, the database will generate a voiee recording 
of the detainee’s name. If the two numbers do not mateh, the system will return a prompt 
stating that the caller is not a registered visitor of the detainee. (This is a non-recognition 
processing state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngDetaineeAppt#ConfirmDetaineeISN 

EngDetaineeAppt#GetVisitationDate 


d. Actions 


Condition 

Action 

Goto 


Next, please wait while 1 check to see if you’re a 

registered visitor of the detainee with ISN [URL 

Expression] [lOOOmsecs] Thanks. I’ve confirmed 

EngDetaineeAppt#GetVis 

itationDate 
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that you’re a registered visitor of Abu Musab Al- 
Zarqawi 

Details: 

CheckDetaineelSN initPartl “Next, please wait 
while I check to see if you’re a registered visitor of 
the detainee with ISN” 

URL Expression: genlSNumber(DetaineelSN) 
Silence: 1000 msecs 

CheckDetaineeISN_initPart2 “Thanks. I’ve 
confirmed that you’re a registered visitor of’ 
DetaineeName “Abu Musab Al-Zarqawi” 


25, EngDetaineeAppt#ConfirmDetaineeISN 

a. Description 

This process asks callers to confirm the detainee’s 9-digit ISN. (This is a 
recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngDetaineeAppt#EnterDetaineeISN 

EngDetaineeAppt#EnterDetaineeISN 

EngDetaineeAppt#CheckDetaineeISN 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

I heard [URL Expression] Is that right? 

Details: 

GenericPromptConfirm_partl “1 heard” 

URL Expression: genlSNumber(DetaineelSN) 

GenericPromptConfirm_part2 “Is that right?” 
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e. Grammar: 

EngDetaineeAppt_ ConfirmDetaineeISN.gsl#Basic_ Yes_No 


NL Slots 

Values 

<confirm> 

yes, no 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS. interpretation, c 

I’m sorry. 

EngDetaineeAppt#EnterD 

onfirm = “no” 

Details: 

Generic imSorry “I’m sorry.” 

etaineelSN 

lastresultS .interpretation, c 


EngDetaineeAppt#Check 

onfirm = “yes” 


DetaineelSN 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

I heard the detainee’s ISN as [URL 

Expression] If that’s right, say ‘yes’. If 

it’s not, say ‘no’. 

Continue with rec in this 

state. 


Details: 

ConfirmDetaineelSN error “I heard the 

detainee’s ISN as” 

URL Expression: 

genlSNumber(DetaineelSN) 

GenericPromptConfirm yesNo “If 
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that’s right, say ‘yes’. If it’s not, say 

‘no’.” 


WHEN(COUNT = 2) 

I heard the detainee’s ISN as [URL 

Continue with ree in this 

nomatch noinput 

Expression] If that’s right, say ‘yes’. If 

state. 

maxspeechtimeout 

it’s not, say ‘no’. 

Details: 

ConfirmDetaineelSN error “I heard the 

detainee’s ISN as” 

URL Expression: 

geni SNumb er(DetaineelSN) 

GenericPromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 

‘no’.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

I’d like to make sure that I heard the 

Continue with ree in this 


detainee’s ISN correetly. That was 

[URL Expression] If that’s right, say 

‘yes’. If it’s not, say ‘no’. 

state. 


Details: 

ConfirmDetaineelSN help “Ed like to 

make sure that I heard the detainee’s 

ISN correctly. That was” 

URL Expression: 

genI SNumb er(DetaineelSN) 

GeneriePromptConfirm yesNo “If 

that’s right, say ‘yes’. If it’s not, say 



‘no’.” 
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26, EngDetaineeAppt#ConfirmVisitationDateTime 


a. Description 

This process confirms the date and time of the requested visit was 
collected. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngDetaineeAppt#GetVisitationTime 

EngDetaineeAppt#GetVisitationDate 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

I heard that you’d like to visit Abu Musab Al-Zarqawi on [date:m] 

[SOmsecs] [date:d] [SOmsecs] [date;y] [SOmsecs] [TTS Expression] 

[lOOmsecs] Is that right? 

Details: 

ConfirmVisitationDateTime confirml “I heard that you’d like to visit” 

DetaineeName “Abu Musab Al-Zarqawi” 

Generic on “on” 

TTS Expression [date:m]: DATE OUT month 

Silence: 50 msecs 

TTS Expression [date:d]: DATE OUT day 

Silence: 50 msecs 

TTS Expression [date:y]: DATE OUT year 

Silence: 50 msecs 

TTS Expression: TIME OUT time + “ + TIME OUT AM PM 

Silence: 100 msecs 

GenericPromptConfirm_part2 “Is that right?” 
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e. Grammar: 

EngDetaineeAppt_ Confirm VmtationDateTime.gsl#Basic_ Yes_N 
o 


NL Slots 

Values 

<confirm> 

no, yes 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS. interpretation, c 

I’m sorry. 

EngDetaineeAppt#GetV is 

onfirm = “no” 

Details: 

Generic imSorry “I’m sorry.” 

itationDate 

lastresultS. interpretation, c 

Thanks, I’ve submitted the details of your request 

Return to the calling 

onfirm = “yes” 

for this visit. Please call us back in 24 hours to see 

if your requested visit has been scheduled. 

Details: 

ConfirmDateTime_post “Thanks, I’ve submitted 

the details of your request for this visit. Please call 

us back in 24 hours to see if your requested visit 

has been scheduled.” 

dialog 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

I’d like to make sure that I got all the 

details for your request correctly. You’d 

Continue with rec in this 

state. 
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maxspeechtimeout 


like to visit Abu Musab Al-Zarqawi on 
[date:m] [50msecs] [date:d] [SOmsecs] 
[date:y] at [SOmsecs] [time:hm] Is that 
right? 


Details: 

ConfirmVisitationDateTime help “I’d 
like to make sure that I got all the details 
for your request correctly. You’d like to 
visif’ 

DetaineeName “Abu Musab Al- 
Zarqawi” 

Generic on “on” 

ITS Expression [date:m]: 
DATEOUTmonth 
Silence: 50 msecs 
ITS Expression [date:d]: 
DATEOUTday 
Silence: 50 msecs 
ITS Expression [date:y]: 
DATEOUTyear 
Generic at “at” 

Silence: 50 msecs 

TTS Expression [time:hm]: 

TIME_OUT_time + “ + 

TIME OUT AM PM 


WHEN(COUNT = 2) 
nomatch noinput 
maxspeechtimeout 


GenericPromptConfirm_part2 “Is that 
right?” 

I’d like to make sure that I got all the Continue with rec in this 
details for your request correctly. You’d state, 
like to visit Abu Musab Al-Zarqawi on 
[date:m] [50msecs] [date:d] [50msecs] 

[date:y] at [50msecs] [time:hm] Is that 
right? 
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Details: 

ConfirmVisitationDateTime help “I’d 
like to make sure that I got all the details 
for your request correctly. You’d like to 
vish” 

DetaineeName “Abu Musab Al- 
Zarqawi” 

Generic on “on” 

ITS Expression [date:m]: 
DATEOUTmonth 
Silence: 50 msecs 
ITS Expression [date:d]: 
DATEOUTday 
Silence: 50 msecs 
ITS Expression [date:y]: 
DATEOUTyear 
Generic at “at” 

Silence: 50 msecs 

TTS Expression [time:hm]: 

TIME_OUT_time + “ + 

TIMEOUTAMPM 

GenericPromptConfirm_part2 “Is that 

right?” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

I’d like to make sure that I got all the 

details for your request correctly. You’d 

like to visit Abu Musab Al-Zarqawi on 

[date:m] [50msecs] [date:d] [50msecs] 

[date:y] at [50msecs] [time:hm] Is that 

right? 

Continue with 

rec in this state. 


Details: 



225 









ConfirmVisitationDateTime help “I’d 
like to make sure that I got all the details 
for your request correctly. You’d like to 
vish” 

DetaineeName “Abu Musab Al- 
Zarqawi” 

Generic on “on” 

ITS Expression [dateun]: 
DATEOUTmonth 
Silence: 50 msecs 
ITS Expression [date:d]: 
DATEOUTday 
Silence: 50 msecs 
ITS Expression [date:y]: 
DATEOUTyear 
Generic at “at” 

Silence: 50 msecs 

TTS Expression [time:hm]: 

TIME_OUT_time + “ + 

TIMEOUTAMPM 

GenericPromptConfirm_part2 “Is that 

right?” 


27, EngDetaineeAppt#EnterDetaineeISN 

a. Description 

This process asks callers to enter a detainee’s ISN to schedule a visit. 
(This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngDetaineeAppt#New Appointment 

EngDetaineeAppt#ConfinnDetaineeISN 

EngDetaineeAppt#ConfirmDetaineeISN 
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d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Please say or key in all 9-digits of the detainee’s ISN. 


Details: 

EnterDetaineelSN init “Please say or key in all 9-digits of the 

detainee’s ISN.” 

Entry Type = reentry 

Please give me the 9-digit ISN one more time. 


Details: 

EnterDetaineelSN reentry “Please give me the 9-digit ISN one more 

time.” 


e. Grammar: builtin:digits?length=9;minlength=9;maxlength=9 


NL Slots 

Values 

<userlnput> 

detaineelSN 

Sample Phrases 

Slots Filled 

’’one two three four five six seven eight nine” 

<built-in “yes”> 


f. Actions 


Condition 

Action 

Goto 

lastresult == true 

Thanks. 



Details: 



Generic thanks “Thanks.” 


— 

Assign: DetaineelSN = lastresult 

EngDetaineeAppt#Confir 

mDetaineelSN 


g. Error Behaviors 
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Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

Please say or key-in the detainee’s 9- 

Continue with rec in this 

nomatch noinput 

digit ISN. 

state. 

maxspeechtimeout 

Details: 

EnterDetaineelSN error “Please say or 

key-in the detainee’s 9-digit ISN.” 


WHEN(COUNT = 2) 

Please say or key-in the detainee’s 9- 

Continue with rec in this 

nomatch noinput 

digit ISN. 

state. 

maxspeechtimeout 

Details: 

EnterDetaineelSN error “Please say or 

key-in the detainee’s 9-digit ISN.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

Please say or key-in the detainee’s 9- 

Continue with rec in this 


digit ISN. 

state. 


Details: 

EnterDetaineelSN error “Please say or 

key-in the detainee’s 9-digit ISN.” 



28, EngDetaineeAppt#GetVisitationDate 

a. Description 

This process asks callers to speeify a eomplete date (day, month, and year) 
of their requested visit. (This is a recognition state.) 

b. Special Features 


c. Entry and Exit States 


Entry States 


Exit States 
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EngDetaineeAppt#CheckDetaineeISN 

EngDetaineeAppt#GetV isitationT ime 

EngDetainee Appt#Confin'nV isitationDateT ime 



d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Please tell me the date for when you’d like to visit. Abu Musab Al- 

Zarqawi Please say a complete date, including the month, day and year. 

For example, you could say May 18, 2005. 


Details: 


GetVisitationDate initPartl “Please tell me the date for when you’d 

like to visit.” 

DetaineeName “Abu Musab Al-Zarqawi” 

GetVisitationDate initPart2 “Please say a complete date, including the 

month, day and year. For example, you could say May 18, 2005.” 

Entry Type = reentry 

Please tell me the full date once again. For example, you could say May 

18, 2005. 


Details: 


GetVisitationDate reentryPartl “Please tell me the full date once 

again.” 

GetVisitationDate reentryPart2 “For example, you could say May 18, 

2005.” 


e. Grammar: 

EngDetaineeAppt_ Get VisitationDate.gsl#DA TE_ VOICE_ OR_D 
TMF 


NL Slots 

Values 

<day> 

day 
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<month> 

month 

<year> 

year 

Sample Phrases 

Slots Filled 

’’may thirteenth nineteen ninety-nine” 

<day day> 

<month month> 

<year year> 

’’the thirteenth of may nineteen ninety nine” 

<day day> 

<month month> 

<year year> 

’’five thirteen nineteen ninety nine” 

<day day> 

<month month> 

<year year> 


f. Actions 


Condition 

Action 

Goto 


Assign: DATE OUT day = 

lastresult $. interpretation. date. day 

Assign: DATE OUT month = 

lastresult $. interpretation. date. month 

Assign: DATE OUT year = 

lastresultS. interpretation, date, year 

Log: ’DATE OUT day is ‘ + DATE OUT day 

Log: ’DATE OUT month is ‘ + 

DATEOUTmonth 

Log: ’DATE OUT year is ‘ -^DATE OUT year 


— 

Thanks. 

EngDetaineeAppt#GetV is 

itationTime 
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Details: 

Generic thanks “Thanks.” 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Tell me the date that you’d like to visit. 

Abu Musab Al-Zarqawi Please say a 

complete date, including the month, day 

and year. For example, you could say 

May 18, 2005. 

Continue with rec in this 

state. 


Details: 

GetVisitationDate errorPartl “Tell me 

the date that you’d like to visit.” 

DetaineeName “Abu Musab Al- 

Zarqawi” 

GetVisitationDate errorPart2 “Please 

say a complete date, including the 

month, day and year. For example, you 

could say May 18, 2005.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Tell me the date that you’d like to visit. 

Abu Musab Al-Zarqawi Please say a 

complete date, including the month, day 

and year. For example, you could say 

May 18, 2005. 

Continue with rec in this 

state. 


Details: 

GetVisitationDate errorPartl “Tell me 

the date that you’d like to visit.” 

DetaineeName “Abu Musab Al- 

Zarqawi” 

GetVisitationDate errorPart2 “Please 

say a complete date, including the 

month, day and year. For example, you 
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could say May 18, 2005.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

To set up your appointment, I need to 

Continue with rec in this 


know the date that you’d like to visit. 

Abu Musab Al-Zarqawi Please tell me 

the complete date, including the month, 

day and year. For example, you could 

say May 18, 2005. 

state. 


Details: 

GetVisitationDate helpPartl “To set up 

your appointment, I need to know the 

date that you’d like to visit.” 

DetaineeName “Abu Musab Al- 

Zarqawi” 

GetVisitationDate helpPart2 “Please 

tell me the complete date, including the 

month, day and year. For example, you 

could say May 18, 2005.” 



29. EngDetaineeAppt#GetVisitationTime 

a. Description 

This process asks callers to speeify the hour and minute and AM/PM of 
their requested visit. (This is a recognition state.) 

b. Special Features 

c. Entry and Exit States 


Entry States 

Exit States 

EngDetaineeAppt#GetVisitationDate 

EngDetaineeAppt#ConfirmVisitationDateTime 
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d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

Next, tell me the time you’d like to visit. You can choose any time 


between the hours of 8 AM to 4 PM. 


Details: 

GetVisitationTime init “Next, tell me the time you’d like to visit. You 

can choose any time between the hours of 8 AM to 4 PM.” 


e. Grammar: 

EngDetaineeAppt_ GetVisitation Time.gsl#TIME_ VOICE_ OR_D 
TMF 


NL Slots 

Values 

<am_pm> 

am, pm 

<hr> 

’’[hour]” 

<min> 

”[min]” 

Sample Phrases 

Slots Filled 

”a quarter to six in the morning” 

<am_pm am> 

’’noon” 

<am_pm pm> 

<time 0> 

’’two to two” 

<time 158> 

’’four o’clock p m” 

<am_pm pm> 

<time 400> 


f. Actions 


Condition 

Action 

Goto 

- 

Thanks. 

EngDetaineeAppt#Confir 



mV isitationDateT ime 


Details: 
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Generic_thanks “Thanks.” 

Assign: TIME OUT time = 
lastresult$.interpretation.hr + 
+lastresult$. interpretation. min 

Assign: TIME OUT AM PM = 
lastresult$. interpretation. am_pm 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

nomatch noinput 

maxspeechtimeout 

Just say the time that you’d like to visit 

Abu Musab Al-Zarqawi You can choose 

any time between the hours of 8 AM to 

4 PM. For example, you can say, 2 PM. 

Continue with rec in this 

state. 


Details: 

GetVisitationTime errorPartl “Just say 

the time that you’d like to visit” 

DetaineeName “Abu Musab Al- 

Zarqawi” 

GetVisitationTime errorPart2 “You can 

choose any time between the hours of 8 

AM to 4 PM. For example, you can say, 

2 PM.” 


WHEN(COUNT = 2) 

nomatch noinput 

maxspeechtimeout 

Tell me the date that you’d like to visit. 

Abu Musab Al-Zarqawi You can choose 

any time between the hours of 8 AM to 

4 PM. For example, you can say, 2 PM. 

Continue with rec in this 

state. 


Details: 

GetVisitationDate errorPartl “Tell me 

the date that you’d like to visit.” 

DetaineeName “Abu Musab Al- 
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Zarqawi” 

GetVisitationTime_errorPart2 “You can 
choose any time between the hours of 8 
AM to 4 PM. For example, you can say, 
2 PM.” 


h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

To complete the meeting request, I need 

Continue with rec in this 


to know the time that you’d like to visit. 

Abu Musab Al-Zarqawi You can choose 

any time between the hours of 8 AM and 

4 PM. For example, you can say 2 PM. 

state. 


Details: 

GetVisitationTime helpPartl “To 

complete the meeting request, I need to 

know the time that you’d like to visit.” 

DetaineeName “Abu Musab Al- 

Zarqawi” 

GetVisitationTime helpPart2 “You can 

choose any time between the hours of 8 

AM and 4 PM. For example, you can 

say 2 PM.” 



30 EngDetaineeAppt#NewAppointment 

a. Description 

This process asks callers if they have the detainee’s Internment Serial 
Number (ISN). (This is a reeognition state.) 

b. Special Features 

c. Entry and Exit States 
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Entry States 

Exit States 

EngDetaineeAppt#EngDetaineeAppt 

EngDetaineeAppt#EnterDetaineeISN 


d. Pre-rec Prompts 


Type and Condition 

Action 

Entry Type = initial 

In order to make a new appointment, you must have the detainee’s 

Internment Serial Number, or ISN. Do you have the ISN? 

Details: 

New Appointment init “In order to make a new appointment, you must 

have the detainee’s Internment Serial Number, or ISN. Do you have the 

ISN?” 


e. Grammar: 

EngDetaineeAppt_NewAppointment.gsl#Basic_Yes_No 


NL Slots 

Values 

<confirm> 

yes, no 

Sample Phrases 

Slots Filled 

”no” 

<confirm no> 

”yes” 

<confirm yes> 


f. Actions 


Condition 

Action 

Goto 

lastresultS .interpretation, c 

onfirm = “no” 

In order to make a new appointment to visit a 

detainee, you must have the detainee’s ISN. Due to 

security reasons, we cannot give you the ISN over 

the telephone. But you can get that number by 

going to your local police station. Please call back 

once you get it, and I’ll help you set up your 

Return to the calling 

dialog 
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appointment. 

Details: 

AceessDenial init “In order to make a new 

appointment to visit a detainee, you must have the 

detainee’s ISN. Due to security reasons, we cannot 

give you the ISN over the telephone. But you can 

get that number by going to your local police 

station. Please call back once you get it, and I’ll 

help you set up your appointment.” 


lastresultS. interpretation, c 

onfirm = “yes” 


EngDetaineeAppt#EnterD 

etaineelSN 


g. Error Behaviors 


Error Type 

Action 

Goto 

WHEN(COUNT = 1 ) 

If you have the detainee’s ISN, say ‘yes’. If you don’t. 

Continue with rec in 

nomatch noinput 

say ‘no’. 

this state. 

maxspeechtimeout 

Details: 

New Appointment error “If you have the detainee’s ISN, 

say ‘yes’. If you don’t, say ‘no’.” 


WHEN(COUNT = 2) 

If you have the detainee’s ISN, say ‘yes’. If you don’t, 

Continue with rec in 

nomatch noinput 

say ‘no’. 

this state. 

maxspeechtimeout 

Details: 

New Appointment error “If you have the detainee’s ISN, 

say ‘yes’. If you don’t, say ‘no’.” 



h. State-Specific Universal Behaviors 


Universal Type 

Action 

Goto 

help 

In order to make a new appointiuent, you must have 

the detainee’s Internment Serial Number or ISN. If 

Continue with rec in this 

state. 
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you have the ISN, please say ‘yes’, if you don’t, just 
say ‘no’ and I’ll tell you how to get that information. 

Details: 

NewAppointment_help “In order to make a new 
appointment, you must have the detainee’s 
Internment Serial Number or ISN. If you have the 
ISN, please say ‘yes’, if you don’t, just say ‘no’ and 
I’ll tell you how to get that infonnation.” 


K, ENGMAINMENU APPENDICES 


1, Grammar and Slot Definitions 


Dialog State 

Grammar 

Slots 

Slot Values 

EngMainMenu#EngMainMen 

u 

EngMainMenu EngMainMenu. 

gsl#Sample_Rule 

userinput 

information, directions, 

scheduling. 

Eng]VlainMenu#EngV isitinfor 

mation 

EngMainMenu EngVisitInform 

ation.gsl#Sample_Rule 

Userinput 

repeatMessage, 

retumMainMenu, 

EngMainMenu#EngDirection 

s 

EngMainMenu EngDirections.g 

sl#Sample_Rule 

Userinput 

repeatDirections, 

retumMainMenu, 

EngScheduling#EngScheduli 

ng 

EngSchedulingEngScheduling. 

gsl#Sample_Rule 

userinput 

yes, no, 

EngScheduling#VoiceEnroll 

ment 

builtin: digits?length= 10 ;minleng 

th= 10;maxlength= 10 

userinput 

accountNbr, 

EngScheduling#ConfirmAcco 

untNbr 

EngScheduling ConfirmAccoun 

tNbr.gsl#Basic_Y es_No 

confirm 

yes, no, 

EngScheduling#NbrCountOn 

e 

EngSchedulingNbrCountOne.g 

sl#Sample_Rule 

useinput 

nbrCount, 

Eng S cheduling#Nbr CountT w 

0 

EngScheduling NbrCountTwo.g 

sl#Sample_Rule 

userinput 

nbrCount, 

EngScheduling#NbrCountThr 

EngScheduling NbrCountThree. 

userinput 

nbrCount, 
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ee 

gsl#Sample_Rule 



EngScheduling#EnrollmentPi 

n 

builtin:digits?length=4;minlengt 

h=4;maxlength=4 

enrollmentPin 

pinNbr, 

Eng S cheduling#Confi rmEnro 

llPin 

EngScheduling ConfirmEnrollP 

in.gsl#Basic Yes No 

confirm 

yes, no, 

EngScheduling#EnrollCheck 

EngSchedulingEnrollCheck.gsl 

#Sample_Rule 

userinput 

enrollMeNow, 

EngScheduling#VoiceVerific 

ation 

builtin: digits?length= 10 ;minleng 

th= 10;maxlength= 10 

userinput 

accountNbr, 

EngScheduling#ConfirmAcco 

untNbr2 

EngScheduling ConfirmAccoun 

tNbr2.gsl#Basic Yes No 

confirm 

yes, no, 

EngScheduling#NbrCountV er 

ify 

EngScheduling NbrCountVerifi 

y.gsl#Sample_Rule 

useinput 

nbrCount, 

Eng S cheduling#ConfirmS ecr 

etDate 

EngScheduling ConfirmSecret 

Date.gsl#Basic Yes No 

confirm 

no, yes, 

Eng S cheduling#Get S ecr etDat 

e 

EngSchedulingGetSecretDate.g 

sl#DATE_VOICE_OR_DTMF 

day 

month 

year 

day, 

month, 

year. 

EngDetaineeAppt#EngDetain 

eeAppt 

EngDetaineeAppt EngDetainee 

Appt.gsl#Sample_Rule 

userinput 

newAppoinment, 

checkAppointment, 

EngDetaineeAppt#NewAppoi 

ntment 

EngDetaineeAppt New Appoint 

ment.gsl#Basic Yes No 

confirm 

yes, no, 

EngDetaineeAppt#EnterDetai 

neelSN 

builtin: digits?length=9 ;minlengt 

h=9 ;maxlength=9 

userinput 

detaineelSN, 

EngDetaineeAppt#ConfirmD 

etaineelSN 

EngDetaineeAppt ConfirmDeta 

ineeISN.gsl#Basic Yes No 

confirm 

yes, no, 

EngDetaineeAppt#GetVisitati 

onDate 

EngDetaineeAppt GetVisitation 

Date.gsl#DATE_VOICE_OR_D 

IMF 

day 

month 

year 

day, 

month, 

year. 

EngDetaineeAppt#GetVisitati 

EngDetaineeAppt GetVisitation 

am_pm 

am, pm. 
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onTime 

Time.gsl#TIME_VOICE_OR_D 

IMF 

hr 

min 

’’[hour]”, 

”[min]”, 

EngDetainee Appt#Confin'nV i 

EngDetaineeAppt ConfirmVisit 

confirm 

no, yes, 

sitationDateT ime 

ationDateTime.gsl#Basic Yes 




No 




2, Prompt List 


Prompt File 

Transcription 

help universal 

’’Okay, here’s some help.” 

operator universal 

’’Em sorry, there are no representatives available.” 

global error 1 

’’Sorry.” 

global error2 

’’Sorry. I still didn’t get that.” 

global error3 

’’Sorry, we’re experiencing some technical difficulty right now. 

Please try again at a later time.” 

EngMainMenu init 

’’Please select from the following options. To get general visitor 

information, including visiting hours, say ‘information’. To get 

directions to our facility, say ‘directions’. To set up a meeting 

using our automated scheduling system, say ‘scheduling’.” 

Genericsure 

’’Sure.” 

EngMainMenu help 

’’With this system, you can choose from the following options. If 

you’d like to get general visitor information including visiting 

hours, say ‘information’. If you’d like to get directions to 

Baghdad Central Correctional Facility, say ‘directions’. If you’d 

like to set up a visit with a detainee using our automated 

scheduling system, say ‘scheduling’.” 

EngMainMenu error 

’’Which would you like to do? get information, get directions, or 

use our automated scheduling system.” 

EngVisitInformation init 

’’Baghdad Central Correctional Facility is open for detainee 

visitors from 8 AM to 4 PM, Monday through Saturday. Would 

you like to hear that information again or return to the main 

menu? If you’re done for now, please feel free to hang up.” 
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EngVisitInformation help 

”To hear the visitation information again, say ‘repeat’. To return 

to the main menu, say ‘main menu’. Or if you don’t need anything 

else, say goodbye or just hang up.” 

EngVisitInformation error 1 

’’Which do you want to do: hear the visitor information again or 

return to the main menu? If you’re done, say goodbye or just hang 

up.” 

EngVisitInformation error2 

”If you want to hear the visitor information again, say ‘repeat’. If 

you want to return to the main menu, say ‘main menu’. If you’re 

done, say goodbye or just hang up.” 

EngDirections init 

’’Baghdad Central Correetional Facility is located 20 miles west of 

Baghdad, in the town of Abu Ghraib. From Baghdad, go west on 

highway six for 18 miles then take exit nine at Abu Ghraib. Our 

facility is located 2 miles southwest of exit nine. Would you like 

to hear the directions again or return to the main menu? If you’re 

done for now, please feel free to hang up.” 

EngDirections help 

”To hear the directions to our facility, say ‘repeat’. To return to 

the main menu, say ‘main menu’. If you don’t need anything else, 

say goodbye or just hang up.” 

EngDirections error 1 

’’Which would you like to do: hear the directions again or return 

to the main menu? If you’re done for now, please feel free to hang 

up.” 

EngDirections error2 

”If you want to hear the directions again, say ‘repeat’. If you want 

to return to the main menu, say ‘main menu’. If you’re done, say 

goodbye or just hang up.” 

Eng S cheduling_init 

”In order to use our automated scheduling system, you must be an 

enrolled user. Are you an enrolled user? If you are, say ‘yes’. If 

you’re not, say ‘no’ and I’ll help you to enroll in our system.” 

Generic thanks 

’’Thanks.” 

Eng S cheduling_help 

”In order to use our automated scheduling system, you must be an 

enrolled user. If you are already enrolled in our automated 

scheduling system, say ‘yes’. If you’re not, say ‘no’ and I’ll help 

you to enroll in our system.” 
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Eng S cheduling_error 1 

”If you’re enrolled, say ‘yes’. If you’re not, say ‘no’ and I’ll help 

you to enroll in our system.” 

Eng S cheduling_error2 

”If you’re already enrolled in our system, say ‘yes’. If you’re not 

or if you’re not sure, say ‘no’, and I’ll help you to enroll in our 

system.” 

VoiceEnrollment init 

”To get started on the voice enrollment process, I need your 10- 

digit account number. If you don’t have an account number, or if 

you’ve lost it, please go to your nearest police station to register 

for a new account. If you have the account number, go ahead and 

say or key it in now.” 

VoiceEnrollment reentry 

’’Please say or key-in your 10-digit account number one more 

time.” 

VoiceEnrollment help 

”In order to enroll in our automated scheduling system, you must 

have a 10-digit account number. If you don’t have your account 

number or if you’ve lost it, please hang up and go to your local 

police station to register for a new account. If you have your 

account number, please say or key-in the number now.” 

VoiceEnrollment error 1 

’’Please say or key-in your 10-digit account number.” 

VoiceEnrollment error2 

”To get you started on the voice enrollment process, I need to 

have your 10-digit account number. Please key it in, or say ‘help’ 

for more information.” 

Generic imSorry 

’’I’m sorry.” 

Generic great 

’’Great!” 

NbrCountOne init 

’’Now, to create your voiceprint, first I’ll ask you to count from 1 

to 9, three separate times, so that the system can analyze your 

voice. Then I’ll ask you for some secret information that we might 

need to get from you occasionally, just for extra security. So to get 

started, please count out loud, once from 1 to 9 like this, one, two, 

three, and so on.” 

NbrCounthelp 

”In order to create your voiceprint, please count out loud, once 

from 1 to 9 like this, one, two, three, and so on.” 


NbrCount error 


’’Please count out loud, once, from 1 to 9 like this one, two, three. 










and so on.” 


NbrCountTwo init 

’’And, once more, please?” 

NbrCountThree init 

’’And one last time.” 

EnrollmentPin init 

’’Next, I need to get the 4-digit enrollment code from the 

enrollment notice that we sent you. So take a moment to find that 

code now, and when you’re ready, go ahead and say it, or just key 

it in.” 

EnrollmentPin reentry 

’’Please say or key in your 4-digit enrollment code again.” 

EnrollmentPin help 

’’Please say or key in your 4-digit enrollment code from the 

enrollment notice that we sent you.” 

EnrollmentPin error 

’’Please say or key in your 4-digit enrollment code.” 

EnrollCheck init 

’’Now it looks like we haven’t yet enrolled you in our Voiceprint 

Verification System. This’ll let us identify you using your unique 

voiceprint, which is faster and more convenient that a PIN or 

password. We only need to enroll you once, and it’ll just take a 

minute. To go ahead with the enrollment process right now, say 

‘enroll me now’.” 

EnrollCheck help 

”To go ahead with the enrollment proeess right now, say ‘enroll 

me now’.” 

EnrollCheck error 

”To get started on the enrollment process, say ‘enroll me now’.” 

VoiceVerification init 

”To get started, go ahead and say or key-in your 10-digit account 

number.” 

VoiceVerification reentry 

’’Please say or key-in your 10-digit account number one more 

time.” 

VoiceVerification help 

”To get started on the voice verification process, please say or 

key-in your 10-digit account number. If you don’t have a 10-digit 

account number or if you’ve lost it, please go to your local police 

station to register for a new account. If you have the number, 

please go ahead and say or key it in now.” 

VoiceVerification error 1 

’’Please say or key-in your 10-digit account number.” 
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VoiceVerification error2 

’’Please key-in your 10-digit aecount number or say ‘help’ for 

more information.” 

NbrCountVerify init 

’’Now to verify your voiee, please count out loud from one up to 

nine.” 

NbrCountVerify_post 

’’You’re been verified.” 

NbrCountVerify help 

”In order to verify your account, please count out loud once from 

1 to 9 like this, one, two, three and so on.” 

RemindDate init 

’’Now think of a hint that’ll remind you of that date. After you 

hear the beep, tell me that hint and we’ll record it so that we can 

play it back to you later. So, for example, you might say my 

mother’s birthday or my graduation date.” 

RemindDate_po st 

”OK! we’ve successfully enrolled your voiceprint.” 

RemindDate error 

’’Please tell me a hint that will remind you of your secret date.” 

GetSeeretDate init 

’’Next I’ll get the secret information that we’ll ask you for 

occasionally. This’ll be a date that’s easy for you to remember, 

but hard for others to guess, like a special anniversary or a 

friend’s birthday. So, think of the secret date you’d like to use, 

and when you’re ready, just tell me that date, including the year, 

like this April 1st 1998.” 

GetSeeretDate reentry 

’’Please reenter your secret date, like this, April 1st 1998.” 

GetSeeretDate help 

’’Please enter a secret date that’s easy for you to remember, but 

hard for others to guess. When you’re ready, just tell me that date, 

including the year, like this April 1st 1998.” 

GetSeeretDate error 1 

’’Please say or key in your secret date, like this, April 1st 1998.” 

GetSeeretDate error2 

’’Please enter a date that’s easy for you to remember, but hard for 

others to guess, like a special anniversary or a friend’s birthday. 

So, think of the secret date you’d like to use, and when you’re 

ready, just tell me that date, including the year, like this April 1st 

1998.” 

EngDetaineeAppt init 

’’Next, please select from the following options. If you’d like to 

make a new appointment, say ‘new appointment’. If you’d like to 
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check the status of a pending appointment, say ‘check 

appointment’.” 

EngDetaineeAppt help 

”If you’d like to make a new appointment to meet with a detainee, 

say ‘new appointment’. If you’d like to check a pending 

appointment to see if it has been scheduled, say ‘check 

appointment’.” 

EngDetaineeAppt error 1 

’’Which did you want to do: set up a new appointment or check a 

pending appointment?” 

EngDetaineeAppt error2 

”To set up a new appointment now, say ‘new appointment’. To 

check a pending appointment, say ‘check appointment’.” 

NewAppointment init 

”In order to make a new appointment, you must have the 

detainee’s Internment Serial Number, or ISN. Do you have the 

ISN?” 

AccessDenial init 

”In order to make a new appointment to visit a detainee, you must 

have the detainee’s ISN. Due to security reasons, we cannot give 

you the ISN over the telephone. But you can get that number by 

going to your local police station. Please call back once you get it, 

and I’ll help you set up your appointment.” 

NewAppointment help 

”In order to make a new appointment, you must have the 

detainee’s Internment Serial Number or ISN. If you have the ISN, 

please say ‘yes’, if you don’t, just say ‘no’ and I’ll tell you how to 

get that information.” 

NewAppointment error 

”If you have the detainee’s ISN, say ‘yes’. If you don’t, say ‘no’.” 

EnterDetaineelSN init 

’’Please say or key in all 9-digits of the detainee’s ISN.” 

EnterDetaineelSN reentry 

’’Please give me the 9-digit ISN one more time.” 

EnterDetaineelSN error 

’’Please say or key-in the detainee’s 9-digit ISN.” 

CheckAppointment init 

’’Based on our records, you have no scheduled appointments at 

this time. If you’ve called earlier to set up an appointment, note 

that it takes 24 hours for the appointment to get scheduled. Please 

check back at a later time.” 

GetVisitationTime init 

’’Next, tell me the time you’d like to visit. You can choose any 
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time between the hours of 8 AM to 4 PM.” 

ConfirmDateT ime_post 

’’Thanks, I’ve submitted the details of your request for this visit. 

Please call us back in 24 hours to see if your requested visit has 

been scheduled.” 

GenericPromptConfirm_part 1 

”I heard” 

GenericPromptConfirm_part2 

”Is that right?” 

ConfirmAccountNbr help 

’’I’d like to make sure that I heard your account number correctly. 

That was” 

GenericPromptConfirm yesNo 

”If that’s right, say ‘yes’. If it’s not, say ‘no’.” 

ConfirmAccountNbr error 

”I got your account number as” 

ConfirmEnrollmentPin help 

’’I’d like to make sure that I heard your enrollment code correctly. 

That code was” 

ConfirmEnrollmentPin error 

”I got your secret date as” 

ConfirmSecretDate help 

’’I’d like to make sure I got your secret date correctly. If your 

secret date is” 

ConfirmSecretDate error 

’’I’d like to make sure I got your secret date correctly. I heard the 

date as” 

ConfirmDetaineelSN help 

’’I’d like to make sure that I heard the detainee’s ISN correctly. 

That was” 

ConfirmDetaineelSN error 

”I heard the detainee’s ISN as” 

CheckDetaineelSN initPartl 

’’Next, please wait while I check to see if you’re a registered 

visitor of the detainee with ISN” 

CheckDetaineelSN initPart2 

’’Thanks. I’ve confirmed that you’re a registered visitor of’ 

DetaineeName 

”Abu Musab Al-Zarqawi” 

GetVisitationDate initPartl 

’’Please tell me the date for when you’d like to visit.” 

GetVisitationDate initPart2 

’’Please say a complete date, including the month, day and year. 

For example, you could say May 18, 2005.” 

GetVisitationDate reentryPartl 

’’Please tell me the full date once again.” 
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GetVisitationDate_reentryPart2 


’’For example, you eould say May 18, 2005.” 




GetVisitationDate helpPartl 

”To set up your appointment, 1 need to know the date that you’d 

like to visit.” 

GetVisitationDate helpPart2 

’’Please tell me the complete date, including the month, day and 

year. For example, you could say May 18, 2005.” 

GetVisitationDate errorPartl 

’’Tell me the date that you’d like to visit.” 

GetVisitationDate errorPart2 

’’Please say a complete date, including the month, day and year. 

For example, you could say May 18, 2005.” 

GetVisitationTime helpPartl 

”To complete the meeting request, 1 need to know the time that 

you’d like to visit.” 

GetVisitationTime helpPart2 

’’You can choose any time between the hours of 8 AM and 4 PM. 

For example, you can say 2 PM.” 

GetVisitationTime errorPartl 

’’Just say the time that you’d like to visit” 

GetVisitationTime errorPart2 

’’You can choose any time between the hours of 8 AM to 4 PM. 

For example, you can say, 2 PM.” 

ConfirmVisitationDateTime confirml 

”I heard that you’d like to visit” 

Generic on 

”on” 

ConfirmVisitationDateTime help 

’’I’d like to make sure that I got all the details for your request 

correctly. You’d like to visit” 

Generic at 

”at” 
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APPENDIX B. NPS SPEAKER VERIFICATION TEST 
INVITATION LETTER 


14 April 2005 

From: Mr, James Ehlert, Naval Postgraduate School (NPS), Information Sciences Department 
To: Prospective Participants 

Sub]: INVITATION LETTER FOR NPS VOICE ENROLLMENT AND VERIFICATION TEST, 

End: (1) Sample Voice Enrollment and Verification Call-flow 

(2) Participant Consent Form 

(3) Minimal Risk Consent Statement 

(4) Privacy Act Statement 

(5) User Feedback Questionnaire 

Ladies and Gentlemen, 

1, On behalf of the Naval Postgraduate School (NPS), I would like to respectfully request your 
participation in a voice verification test (dates provided below). The research program is conducted by 
NPS and is sponsored by the Office of Secretary of Defense (OSD), The test will attempt to study the 
feasibility of remote voice enrollment and voice verification in support of War on Terrorism (WoT) 
security requirements. During this test NPS will evaluate the voice verification accuracy of a 
commercially pcickaged voice verification application called Nuance Caller Authentication (NCA) 1,0 
provided by Nuance Communications Inc, 


2, Test Period , Tire voice verification test will be conducted in two phases, as described below: 


Date 

Event 

Remark 

20-24 Apr 05 

(We.4-Snii) 

Inifinl Voice Eiirolhiienf 
& 

Voice Verificntloii Testing 

The voice verification system ivill he operatioHal from 

Wednesday, April 20, 12:00 AM (PST) to Snnday, April 24, 
11:59 PM (FST). 

2-8 Mmf 05 

(Mou-Suu) 

Voice Verification Testing 

The voice I'erification system will he operational from Monday, 
May 2, 12:00 AM (PST) to Sunday, May 8, 2005 11:59 PM' 
(PST). 


For the initial voice enrollment and verification testing (20-24 Apr 05) please call one of the following 
telephone numbers listed below, six separate times during the first test period: once to enroll your voice 
biometric and five times to verify your voice biometric. Please space out the frequency of your calls to 
the system with a minimum of 4-hours in between each call. 

And for subsequent voice verification testing (2-8 May 05) please call the system again, four separate 
times to verify your voice biometric, for a total of ten calls for the entire voice verification test, 

■ (831) 656-1905 

■ (831) 656-1906 

■ (831) 656-1907 
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Note: Due to n Inrge iiitiiiher of users, the sijsteiii may he busy; in this case please call one of the other telephone 
tininhers listed above or try again at a later time. Also, it is not necessary to enroll and I’erify yonr zioice biometric 
on the same telephone nnmber, yon may enroll using one of the listed tedephone nnndvr nbot^e and verify on another, 
all three telephone nnmbers are linked to the same database. Yonr participation is very important for the success of 
this project. 

3. Test Instructions . 

As a participant, please respond to system prompts. The voice enrollment process will take less than two 
minutes to complete and the verification process will take less than a minute. Enclosure (1) is provided to 
demonstrate the call flow dialog of the enrollment and verification process. 

During the initial enrollment phase, the system will ask you for a 10-digit account number. NFS 
recommends using your telephone number but any 10-digit number will suffice. NFS also recommends 
participants write down their 10-digit number since it is the unique identifier that matches your voice 
sample to your stored voice biometric. 

In addition to the 10-digit number, the system will also ask you for a 4-digit enrollment pin code, please 
use any 4-digit code for the enrollment pin code. It is not necessary to remember the 4-digit FIN once 
you have enrolled in the system. 

4. Consent Forms . In order to participate in this test, please sign and complete the following enclosed 
forms (see below) and send it via email to sklee@nps.edu or via fax to (831) 656-3679, attention; Capl 
Samuel Lee. These forms are to ensure your privacy and to ensure you that the data collected in support 
of this test will be kept in strict confidentiality. 

Note: The system will not ask yon for any sensitive information like name, social security nnmber, and etc. 

• Farticipant Consent Form (see Enclosure 2) 

• Minimal Risk Consent Statement (see Enclosure 3) 

• Frivacy Act Statement (see Enclosure 4) 

5. Test Feedback . Lastly, upon completion of this test, please fill out the attached User Feedback 
Questionnaire (see Enclosure 5) and send it via email to sklee@nps.edu or via fax to (831) 656-3679, 
attention: Capt Samuel Lee. Your feedback is very important to us. 

6. The NFS greatly appreciates your participation in this test. If there are any questions please contact 
my points-of-contact in this matter: Capt Samuel Lee at (831) 869-9638 or via email at sklee@nps.edu, or 
Dr. Fat Sankar at (714) 206-7685 or via email at pvsankar@nps.edu. 

Very Respectfully, 

James Ehlert 

NSA Cryptologic Research Chair 
Naval Fostgraduate School 
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SAMPLE NCA SYSTEM ENROLLMENT CALL ELO^Y 

System: Thanks for calling Nuance Caller Authentication, powered by Nuance Verifier! To get started, go ahead and say or key- 
in your 10-digit account number. 

Caller: (Speech or DTMF enhy) 8005551212 

System: Thanks. I heard 8005551212. Is that righC 

Caller: Yes. 

System: Thanks. And next, I need to get the 4-digit enrollment code from the enrollment notice that we sent you. So take a 
moment to find that code now, and when you ’re ready, go ahead and say it, or just key' it in. 

Caller: 12 34 

System: Thanks. I heard 1 2 3 4. Is that right? 

Caller: Yes. 

System: Great. Now, it looks like we haven ’tyet enrolled you in the Voicepnnt Vetification System. This'll let us identify you 
using your unique voiceprint, which is faster and more convenient than a PIN or pass^vord. We only need to enroll you once, and 
it ’ll just take a minute. If you’d like more information about voice verification before we get started, just say ‘tell me more. ’ 
Otherwise, to go ahead with the enrollment process right now, say “enroll me now. ” 

Caller: Enroll me now. 

System: OK. Now, to create your voiceprint, first I’ll ask you to count from 1 to 9, three separate times, so that the system can 
analyze your voice. Then I'll ask you for some secret inforynation that we might need to get from you occasionally, just for extra 
security. So to get started, please count out loud, once, from 1 to 9 like this: one, two, three, and so on. 

Caller: 123456789 

System: And, once more, please? 

Caller: 123456789 

System: And one Iasi time. 

Caller: 123456789 

System: Thanks. Now, next. I'll get the secret information that we ’ll ask you j'or occasionally. This '// be a date that’s easy for 
you to remember, but hai'd for others to guess, like a special anniversary or a j'riend ’s birthday. So, think of the secret date you’d 
like to use, and when you ’re ready, just tell me that date, including the year, like this: ‘April 1st, 1998. ’ Or say, 7 want to enter 
it using touch-tones. ’ 

Caller: November 10th, 1998. 

System: I heard that date as: November 10th, 1998. Did I get that right? 

Caller: Yes. 

System: Great. Now, think of a hint that'll remind you of that date. After you hear the beep, tell me that hint and we’ll record it so 
that we con play it back to you later. So, for example, you might say ‘my mother’s birthday, ’ or ‘my graduation date. ’ (Hard¬ 
coded system beep) 

Caller: My cat’s birthday. 

System: OK! We’ve successfully enrolled your voiceprint. Thanks for calling Nuance Caller Authentication. Goodbye! 


251 



SAMPLE .NCA SYSTEM VOICE Al THENTICATION C ALL ELOW 

Scenario 1, In the first scenario, the system is “sure” of the decision after the first Enrollment Digit String (EDS) 
utterance. 

System: Welcome to Nuance Caller Authentication, powered by Nuance Verifier. 

To get started, go ahead and say or key-in your 10-digit account number. 

Caller: 8005551 212. 

System: Thanks. I heard: 800555121 2. Did I get that right? 

Caller: Yes. 

System: Thanks. Now, to verify your voice, please count out hud from one up to nine. 

Caller: 1 2 3 4 5 6 7 8 9. 

System: You’ve been verified. 


Scenario 2. In the second scenario, the system is “unsure” of the decision even after two repetitions of the EDS, and 
uses knowledge verification (where the knowledge is a secret date selected by the caller at enrollment time) to make 
the final decision. 

System: Welcome to Nuance Caller Authentication, powered by Nuance Verifier. 

To get started, go ahead and say or key-in your 10-digit account number. 

Caller: 8 005551 212. 

System: Thanks. I heard: 800555121 2. Did I get that right? 

Caller: Yes. 

System: Thanks. Now, to verify your voice, please count out hud from one up to nine. 

Caller: 12345678 9. 

System: And, once more, please? 

Caller: 1 2 3 4 5 6 7 8 9. 

System: OK. And finally, think of the date that ans-wers this hint: 

(Playback of caller’s recorded hint) 

"My cat’s birthday ." 

Now, give me that date, including the year. You can either say it, or use your touchtone keypad to enter the 8 digits that represent 
it, using 2 digits for the month, 2 for the day, and 4 for the year. 

Caller: November 10th, 1998 

System: Great. You’ve been verified. 
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PARTICIPANT CONSENT FORM 

Introduction. You are invited to participate in Naval Postgraduate Sehool’s (NFS) Voice Enrollment and 
Verification Test. This test is in support of NFS’s Iraqi Enrollment via Voice Authentication Project (lEVAP). The 
research program is conducted by NPS and is sponsored by the Office of Secretary of Defense (OSD). The test will 
attempt to study the feasibility of remote voice enrollment and voice verification in support of War on Terrorism 
(WoT) security requirements. During this test NPS will evaluate the voice verification accuracy of a commercially 
packaged voice verification application called Nuance Caller Authentication (NCA) 1.0 provided by Nuance 
Communications Inc. 

Background Information. The Naval Postgraduate School's Voice Authentication Research Team is conducting 
this study. 

Procedures. If you agree to participate in this smdy, the researcher will explain the tasks in detail. There will be 
ten required session: User will enroll and verity their voice biometric by calling into ASR phone system during 
which you will be expected to accomplish a number of tasks related to remote voice enrollment and verification. 

Risks and Benefits. This research involves no risks. The benefits to the participants are gaining techniques for the 
demonstration of this technology for subsequent research and development. 

Compensation. There is no compensated for participating in this study. A copy of the test results will be available 
to you at the conclusion of the c.xpcrimcnt. 

Confidentiality. The records of this study will be kept confidential. No information will be publicly accessible 
which could identify you as a participant. 

V'oluntaiT Nature of the Study. If you agree to participate, you are free to witlidraw from the smdy at any time 
without prejudice. You will be provided a copy of this fonn for your records. 

Points of Contact. If you have any further questions or comments after the completion of the sUidy, you may 
contact the research supervisor, Mr. James Ehlert at (831) 656-3002, jfehlert@nps.navy.mil. 

Statement of Consent. I have read the above information. I have asked all questions and have had my questions 
answered. I agree to participate in tliis smdy. 


Participant’s Signature Date 


Researcher’s Signamre Date 
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MINIMAL RISK CONSENT STATEMENT 
NAVAL POSTGR.\DUATE SCHOOL, MONTEREY, CA 93943 

Participant: VOLUNTARY CONSENT TO BE A RESEARCH PARTICIPANT IN: THE DEMONSTRATION OF 
THE VOICE VERIFICATION TECHNOLOGY IN SUPPORT OF IRAQI ENROLLMENT VIA VOICE 
AUTHENTICATION PROJECT (lEVAP). 

I have read, understand and been provided "Information for Participants" that provides the details of the below 
acknowledgments. 

I understand that this project involves research. An explanation of the puiposes of the research, a description of 
procedures to be used, identification of experimental procedures, and the extended duration of my participation have 
been provided to me. 

I understand that this project does not involve more than minimal risk. I have been infonned of any reasonably 
foreseeable risks or discomforts to me. 

I have been informed of any benefits to me or to others that may reasonably be expected from the research. 

I have signed a statement describing the extent to which confidentiality of records identilying me will be 
maintained. 

I have been infonned of any compensation and/or medical treatments available if injury occurs and is so, what they 
consist of, or where further infonnation may be obtained. 

I understand that my participation in this project is voluntary; refusal to participate w'ill involve no penalty or loss of 
benefits to which I am othenvise entitled. I also understand that I may discontinue participation at any time without 
penalty or loss of benefits to which 

I am otherwise entitled. 

I understand that the individual to contact should I need answers to pertinent questions about the research is Mr. 
James Ehlert, Principal Investigator. A full and responsive discussion of the elements of this project and my consent 
has taken place. 


Signature of Principal Investigator Date 


Signamre of Volunteer Date 
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PRR'ACY ACT STATEMENT 

NAVAL POSTGR.4DUATE SCHOOL, MONTEREY, CA 93943 
PRIVACY ACT STATEMENT 


Purpose: Tlie purpose of this research is to create a pilot POC system using existing commercial off the shelf 
(COTS) Automated Speech Recognition (ASR) technology and COTS Voice Verification (VV) teclmology in order 
to expedite a visitor’s entry to a controlled facility/secure space. 

This research initiates a series of mvestigations into the application of voice technologies by developmg a pilot POC 
system that integrates ASR and VV technology into a mobile platfonn in order to demonstrate a functionality that 
does not exist in order to meet war-fighter requirements. Specifically, this research is intended to contiibute toward 
the fumre employment of voice authentication technologies in a variety of coalition military operations. 

Use: Data collected from this research will be used for statistical analysis by the Departments of the Navy and 
Defense, and other U.S. Government agencies, provided this use is compatible with the purpose for which the 
infonnation was collected. Use of the infonnation may be granted to legitimate non-govemment agencies or 
individuals by the Naval Postgraduate School in accordance with the provisions of the Freedom of Infonnation Act. 


Disclosure/Confldentiality: 

I have been assured that my privacy w'ill be safeguarded. I will be assigned a control or code number that thereafter 
will be the only identifying entiy on any of the research records. Tlie Principal Investigator will maintain the cross- 
rcfcrcnce between name and control number. It will be decoded only when beneficial to me or if some 
circumstances, which is not apparent at this time, would make it clear that decoding would enhance the value of the 
research data. In all cases, the provisions of the Privacy Act Statement will be honored. 

I understand that a record of the infonnation contained in this Consent Statement or derived from the experiment 
described herein tvill be retained permanently at the Naval Postgraduate School or by higher authority. I voluntarily 
agree to its disclosure to agencies or individuals indicated in paragraph 3 and I have been informed that failure to 
agree to such disclosure may negate the purpose for which the experiment was conducted. 
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USER FEEDBACK QUESTIONNAIRE 

1. Wliat 10-digit mimber did you use to enroll and verify your voice biometric? 


2. What medium did yoti use to conduct voice enrolhnent? (Circle one) 

a. Landline telephone 

b. Cellular telephone 

c. VoIP phone 

d. Microphone & speaker 

3. Wliat medium did you use to conduct voice verification? (Circle all that applies) 

a. Landline telephone 

b. Cellular telephone 

c. VoIP phone 

d. Microphone & speaker 

4. Wliat is your overall opinion of this foiiii of biometric teclmology? (Ciicle one) 

a. strongly in favor 

b. moderately in favor 

c. no opinion 

d. moderately opposed 

e. strongly opposed 

5. Did you experience any problems during the voice enrolhnent process? (Circle one) YES NO 

If so, please provide detail in box, to include date and time of call. For additional space, please use back of sheet. 


6. Did you experience any problems during the voice verification process? (Circle one) YES NO 

If so, please provide detail in box, to include date and time of call. For additional space, please use back of sheet. 


7. Would you be willing to use voice biometiics to confirm identity in support of militaiy operations? (Circle one) 

a. strongly in favor 

b. moderately in favor 

c. no opinion 

d. moderately opposed 

e. strongly opposed 
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APPENDIX C. NPS SPEAKER VERIFICATION CALL LOG 

SUMMARY 



Groupid 

nbVerifi cations 

nbAuthentications 

total calls 

last call date 

1 

$1111111111$ 

5 

0 

5 

24-Apr-05 

2 

$1122334455$ 

4 

1 

5 

6-May-05 

3 

$1234567899$ 

20 

0 

20 

24-Apr-05 

4 

$2083789591$ 

12 

0 

12 

5-May-05 

5 

$2084091877$ 

1 

0 

1 

24-Apr-05 

6 

$2085626301$ 

9 

1 

10 

8-May-05 

7 

$2088468779$ 

2 

0 

2 

5-May-05 

8 

$2088711181$ 

2 

0 

2 

22-Apr-05 

9 

$2814658756$ 

9 

2 

11 

5-May-05 

10 

$2815433846$ 

11 

0 

11 

5-May-05 

11 

$2817020380$ 

8 

0 

8 

4-May-05 

12 

$3615334051$ 

4 

0 

4 

8-May-05 

13 

$4046643228$ 

4 

0 

4 

20-Apr-05 

14 

$4048088321$ 

9 

0 

9 

8-May-05 

15 

$4105622615$ 

1 

0 

1 

20-Apr-05 

16 

$4128492799$ 

2 

0 

2 

8-May-05 

17 

$4129512235$ 

0 

1 

1 

8-May-05 

18 

$4129512236$ 

6 

0 

6 

8-May-05 

19 

$4436109744$ 

1 

0 

1 

20-Apr-05 

20 

$5138994280$ 

10 

0 

10 

4-May-05 

21 

$5384276532$ 

4 

0 

4 

4-May-05 

22 

$5712511799$ 

6 

1 

7 

8-May-05 

23 

$6194597270$ 

9 

0 

9 

4-May-05 

24 

$6384276532$ 

1 

0 

1 

7-May-05 

25 

$6385276532$ 

0 

1 

1 

7-May-05 

26 

$7032723578$ 

1 

0 

1 

2-May-05 

27 

$7142067685$ 

34 

0 

34 

8-May-05 

28 

$7243273272$ 

5 

0 

5 

6-May-05 

29 

$7243277727$ 

6 

0 

6 

23-Apr-05 

30 

$7247332939$ 

6 

0 

6 

23-Apr-05 

31 

$7819812682$ 

16 

0 

16 

7-May-05 

32 

$7819812703$ 

4 

0 

4 

22-Apr-05 

33 

$7819814494$ 

1 

0 

1 

21-Apr-05 

34 

$8032613610$ 

4 

1 

5 

24-Apr-05 

35 

$8058787934$ 

2 

0 

2 

6-May-05 

36 

$8084733222$ 

3 

0 

3 

22-Apr-05 

37 

$8312102949$ 

3 

0 

3 

20-Apr-05 
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Groupid 

nbVerifi cations 

nbAuthentications 

total calls 

last call date 

38 

$8312103096$ 

1 

0 

1 

20-Apr-05 

39 

$8312244317$ 

12 

0 

12 

8-May-05 

40 

$8312746454$ 

9 

0 

9 

8-May-05 

41 

$8312746474$ 

3 

2 

5 

8-May-05 

42 

$8312771404$ 

3 

0 

3 

6-May-05 

43 

$8312953880$ 

7 

0 

7 

7-May-05 

44 

$8313331562$ 

9 

1 

10 

4-May-05 

45 

$8313339467$ 

7 

0 

7 

4-May-05 

46 

$8314021584$ 

5 

0 

5 

23-Apr-05 

47 

$8314436128$ 

10 

0 

10 

7-May-05 

48 

$8314793542$ 

2 

0 

2 

23-Apr-05 

49 

$8316449484$ 

11 

0 

11 

8-May-05 

50 

$8316465922$ 

1 

0 

1 

22-Apr-05 

51 

$8316492592$ 

5 

0 

5 

23-Apr-05 

52 

$8316551833$ 

9 

0 

9 

8-May-05 

53 

$8316561006$ 

4 

0 

4 

6-May-05 

54 

$8316561905$ 

1 

0 

1 

24-Apr-05 

55 

$8316563837$ 

8 

0 

8 

21-Apr-05 

56 

$8318404507$ 

5 

0 

5 

23-Apr-05 

57 

$8318404508$ 

5 

0 

5 

6-May-05 

58 

$8318690006$ 

1 

0 

1 

20-Apr-05 

59 

$8318690365$ 

0 

2 

2 

8-May-05 

60 

$8318691356$ 

4 

0 

4 

20-Apr-05 

61 

$8318699638$ 

41 

0 

41 

6-May-05 

62 

$8318840849$ 

1 

0 

1 

21-Apr-05 

63 

$8319159995$ 

1 

0 

1 

6-May-05 

64 

$8319172699$ 

6 

0 

6 

3-May-05 

65 

$8325850031$ 

5 

0 

5 

20-Apr-05 

66 

$9042372253$ 

1 

0 

1 

20-Apr-05 

67 

$9167059780$ 

1 

0 

1 

21-Apr-05 

68 

$9287654321$ 

0 

1 

1 

22-Apr-05 

69 

$9876543210$ 

8 

0 

8 

5-May-05 

70 

$9988776655$ 

5 

0 

5 

22-Apr-05 
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APPENDIX D. NPS SPEAKER VERIFICATION REJECTED 

CALL SUMMARY 


True Failures (False Rejections)(12 attempts) 


User ID 

Time Stamp 

Remarks 

$123456789952734 

4/20/2005 17:39 

True Failure 

$5712511799$ 

5/7/2005 12:38 

True Failure 

$7142067685$ 

5/4/2005 9:48 

True Failure 

$7142067685$ 

5/5/2005 9:57 

True Failure 

$7142067685$ 

5/5/2005 18:15 

True Failure 

$714206768551123 

4/23/2005 12:16 

True Failure 

$7819812682$1111 

4/20/2005 22:40 

True Failure 

$7819812082$1111 

4/20/2005 22:32 

True Failure 

$7819812082$1111 

4/20/2005 22:35 

True Failure 

$781981268281111 

4/21/2005 10:24 

True Failure 

$83122443178 

5/8/2005 10:49 

True Failure 

$831295388051234 

4/23/2005 7:46 

True Failure 


Incomplete Data (13 attempts) 


User ID 

Time Stamp 

Remarks 

$123456789952734 

4/20/2005 17:40 

Utterance 3 is empty 

$2814658756$ 

5/5/2005 18:55 

Hung up, Man enrolled. Female started the process 

$2814658756$ 

0455:46 PM 

Hung up. Man enrolled. Female and male voice mix up 

$2815433846$ 

5/5/2005 19:00 

Incomplete data. Tried to fool the system by saying numbers in 
Spanish, Did give only one utterance 

$4048088321$ 

5/8/2005 9:20 

Did not complete the numbers. Only uttered up to 4 or 5 

$714206768551123 

4/21/2005 7:26 

Many utterances are empty 

$714206768551123 

4/22/2005 9:39 

Third utterance was inaudible 

$8316561006$ 

4/24/2005 12:48 

Incomplete data. 

$8316563837$ 

4/21/2005 10:36 

Hung up. Did not utter 1-2-3- 

$8318404508$ 

4/20/2005 14:42 

Did not utter 1-2-3 at all 

$8318690365$ 

5/7/2005 16:29 

Not previously em'olled 

$8318690365$ 

5/8/2005 11:14 

Not previously enrolled 

$83192712699$ 

4/23/2005 22:01 

Did not utter 1-2-3 at all 
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Correct Rejections (10 attempts) 


User ID 

Time Stamp 

Remarks 

S1234567899S2734 

4/20/2005 17:39 

Sam was trying to break into Jim's account 

S1234567899S2734 

4/20/2005 17:40 

Sam was trying to break into Jim's account 

S1234567899S2734 

4/22/2005 13:54 

Jim was holding his nose tight not nonnal 

S5138994280S 

5/4/2005 17:29 

Imposter attempt thwarted. Female original male 
imposter 

S8316561006S 

5/5/2005 18:34:20 PM 

This was an attempt to break into the system 

S8316561006S 

5/6/2005 17:27:18 PM 

This was an attempt to break into the system 

S8316561006S 

5/6/2005 17:29:08 PM 

This was an attempt to break into the system 

S8316561905S1972 

4/24/2005 13:41 

This was an attempt to break into the system 

S8318691356S 

4/20/2005 17:45 

This was an attempt to break into the system 

S8318699638S1234 

4/20/2005 17:43 

Imposter Attempt Failed 


False Acceptances (5 attempts) 


User ID 

Time Stamp 

Remarks 

S4046643228S 

4/20/2005 17:32 

Imposter attempt system failed 

S4046643228S 

4/20/2005 5:37 

Imposter attempt system did not detect 

S4046643228S 

4/20/2005 5:44 

Imposter attempt system did not detect 

S8316561006S 

5/5/2005 18:31:51 PM 

Imposter attempt system failed 

S8318691356S 

4/20/2005 0:34 

Imposter attempt system did not detect 


Failure to Enroll (12 attempts) 


User ID 

Time Stamp 

Remarks 

51122334455$ 

4,22/2005 12:11 

Failed to enroll 

520856263015 

5,3/2005 18:51 

Failed to enroll 

541295122355 

5/8/2005 10:21 

Failed to enroll. Hung up 

557125117995 

4/22/2005 20:27 

Failed to enroll 

563852776535 

5,7/2005 9:18 

Failed to enroll. Hung up 

58032613601$ 

4/23/2005 13:05 

Failed to enroll 

580326136015 

4/23/2005 13:10 

Failed to eitroll 

580847332225 


Failed to enroll 

583127464745 

5/4/2005 9:03 

Failed to enroll. Hung up 

$83127464745 

5,'4/2005 9:05 

Failed to enroll. Hung up 

583133315625 

5,4/2005 12:36 

Failed to enroll. Hung up 

592876543215 

4/22/2005 19:47 

Failure to enroll 
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APPENDIX E. NUANCE ANALYSIS SUMMARY 


Ctinrlpt: J.wkowcki 

Dirpcior. Sprrch T^hnologv, ProfcMiofiol Servicot 


Naval Postgraduate School 



Outlino 


> Overview 

> Basic Statistics 

> Analysis Methodology 

> Analysis 
Summary 
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Overview 


> Oeploy«d Instance <A Nuance Caller Aulhenllcalion 

• Packaged aoTuttcn lor a^jeolier verAcolian 

• 3*xsrn{ilKO(1-9<orErvolln>ont 

• 1 or 2 ojiamplM of 1'9 for Verincation 

- In Iht fiM. 90% of uKort wouM n«*0 only 1 •Kamgl* 

• No krMyrMdgo vorSication 

- PIN Mcrol dal* 

Conducted Verification Teat 

• VsnatMo^ngtn-vtnAeaaon ee 

- lAlmoei) afl «o«aa«r» «xp«n«rK«d 2 vorifloabon uHtranota 

• No speaker adaptation 

> Goal: Present speaker verification results 

• Bauc (lebtbcs 

• False AoceptiTaise Reyeci rales 



Basic Statistics 


> Enrollments 

> Verifications 

> Rejected calls 

> Two data collection phases 

* Phase I - Late April 

• Phase II - Early May 
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Basic Statistics >* Enrollments 


>71 Total Enrollments 

• 54inPhs»#l 

• 17in Phase II 


■ 







1 -• 

Nil 

1 _ 1 


//////////////////////// 



Basic Statistics - Verifications 


>411 Total Venfication Attempts 

• 204 in Phase I 

• J07 in Phase II 
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Basic Statistics - Verifications 


> Number of attempts by user 



Basic Statistics - Rejected Calls 


> 467411 = 11.1% Rejected True Speaker Attempts 

• 24/204= 11 8% in Phase I 

• 22/207 ■ 10 6% m Phase II 

> Not all were false rejects 

• 7 Identified as 'corroci rejects’ by listening 
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Analysis Methodology 


> Get raw data from application 

> Generate first pass at basic statistics 

> Listen to rejects 

• Identify‘oofrect rejects* 

> Generate second pass at statistics 

• Incorporate correct reiecls 

> Run batchrec with off-line impostor tnals 

• Result ROC curve 

• FA/FR tradeoff 



Analysis Methodology 


> False Reject Rate 

» Verification Altcmpt3 

• Correct reacts ineerleO by listening 

• 411 afiempts 

> False Accept Rate 

• Off-line 

• Eacii verirication minon run aouinvi all oQiar vorcatxiritu 

• '4300 simulated impostor attempts 
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Analysis 


> Identified 7 'correct rejects* 
* Exsmplci 


Enrollment 


Different Speaker 


Different Speaker 


‘Playing* with 
syalem 


4 

4 


Verlficetlon 


Analysis 


> Identified 3 rmdel pairs enrolled by the same 
speaker 

* $538427653219120 and $638427e532$9121 

* S8314021684S1111 and$8316563837$1111 

* $4128492799$2480«td$1122334455$8282 

> During off-line impostor simulation, those pairs 
not used 
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Analysis 



Analysis 


> Companson with 
expected 
perfcxmance 

• WNtMn rang* of 
expectations tram 
other data sets 

• Other data 
EER-3.4% 
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Analysis 


> Phase I/Phase il 

• PhsaclEER 2 8H 

» Phase II EER 3 4% 

• SltgM radueiKKi In 
parformanc* IwlwMn 
M*Won« 

• StawolvM«Mn 
• )lp«cl*d 
parformanc* 

• Actual apfHication 
would UM adaptation 

- 25% reduction in 
PR Q FA«1% 
alter 3 cats. 35% 
alter 6 cate 


MCutm 




Analysis 


> Speakers with 
multiple 
enrollments 

• Effect of renwving 

• Seme EER 

• Mora difterenca at 
lew FA 
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Analysis 


> Remove top 2 most 
frequent speakers 

• RMpontrtM for 10% of 
vtnf^bon atlompi* 

• CVo not war* to ovorfy 

aktrw roMOt 

> Result 

• No aignificani cnonge tn 

porfortnancs 

• Moot froQuont tpoaKor* 
not tkowtog 
porformanco 




Other Studies 


> University of Edinburgh 

• 1 2% Half Total Error Rate (HTER) 

- (FA + FRV2 

• At FA*1 %, current application perforrtring at 2 7% 

- Lower than 3% EER reported HTER^EER 

• More data for erwolbnenl and verification than with current 
trial 

- Multiple phrases 

> IBG 

• 0 8% FAR/1.0% FRR for landline 

• Completely matched harvdBels 

• ftloredata 

- 3x 16 digiis hr both enrollment and veriTication 
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Summary 


> Verification Performance excellent 

> Well within expected ranges 

> Slight decrease between phases, would be 
(more than) addressed using adaptation 

> Performance not skewed by most frequent 
speakers 




ChartM Jankowcld 

chnricsJ^uanc«.com 


www.nuance.com 


TV* Naw VWo* e/B ummm 
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